2025-12-27 23:00:12 [scrapy.utils.log] (PID: 126) INFO: Scrapy 2.12.0 started (bot: catalog_extraction) 2025-12-27 23:00:12 [scrapy.utils.log] (PID: 126) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36 2025-12-27 23:00:12 [mcmaster_carr] (PID: 126) INFO: Starting extraction spider mcmaster_carr... 2025-12-27 23:00:12 [scrapy.addons] (PID: 126) INFO: Enabled addons: [] 2025-12-27 23:00:12 [py.warnings] (PID: 126) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting. It will be removed in a future version of Scrapy. return cls(crawler) 2025-12-27 23:00:12 [scrapy.extensions.telnet] (PID: 126) INFO: Telnet Password: 18f0357af5f607ae 2025-12-27 23:00:12 [py.warnings] (PID: 126) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-12-27 23:00:13 [scrapy.middleware] (PID: 126) INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.closespider.CloseSpider', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon'] 2025-12-27 23:00:13 [scrapy.crawler] (PID: 126) INFO: Overridden settings: {'BOT_NAME': 'catalog_extraction', 'CONCURRENT_ITEMS': 250, 'CONCURRENT_REQUESTS': 8, 'DOWNLOAD_DELAY': 0.9, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/mcmaster_carr/c8af67dce37711f0afa44200a9fe0102.log', 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: ' '%(message)s', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'catalog_extraction.spiders', 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter', 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 522, 524, 408, 429, 420], 'SPIDER_MODULES': ['catalog_extraction.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': None} 2025-12-27 23:00:13 [scrapy_poet.injection] (PID: 126) INFO: Loading providers: [, , , , , , ] 2025-12-27 23:00:13 [scrapy.middleware] (PID: 126) INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware', 'scrapy_poet.InjectionMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy_poet.DownloaderStatsMiddleware'] 2025-12-27 23:00:13 [NotFoundHandlerSpiderMiddleware] (PID: 126) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment. 2025-12-27 23:00:13 [scrapy.middleware] (PID: 126) INFO: Enabled spider middlewares: ['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware', 'catalog_extraction.middlewares.FixtureSavingMiddleware', 'scrapy_poet.RetryMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2025-12-27 23:00:13 [scrapy.middleware] (PID: 126) INFO: Enabled item pipelines: ['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline', 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline', 'catalog_extraction.pipelines.PriceRoundingPipeline', 'scraping_utils.pipelines.AttachSupplierPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline'] 2025-12-27 23:00:13 [scrapy.core.engine] (PID: 126) INFO: Spider opened 2025-12-27 23:00:13 [scrapy.extensions.closespider] (PID: 126) INFO: Spider will stop when no items are produced after 1800 seconds. 2025-12-27 23:00:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:00:13 [scrapy.extensions.telnet] (PID: 126) INFO: Telnet console listening on 127.0.0.1:6024 2025-12-27 23:00:19 [ProxyManagerDownloaderMiddleware] (PID: 126) INFO: Using brd-customer-hl_13cda1e4-zone-sharedpool_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware. 2025-12-27 23:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/colanders/environment-1~food-and-beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/diameter~9-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cold-galvanizing-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/inserts/thread-size~m20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cold-rolled-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steamers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/industry-designation~stw/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collar-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/colanders/environment-1~food-and-beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/diameter~9-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cold-galvanizing-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/inserts/thread-size~m20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cold-rolled-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steamers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/industry-designation~stw/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collar-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:39 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:43 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/material~plastic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/outer-insulation-color~clear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/outer-insulation-color~green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~1-3-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/instrumentation-ball-valves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulated-tube-clamps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-cabinet-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/use-for~drop-down-power/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/material~plastic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/outer-insulation-color~clear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/outer-insulation-color~green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~1-3-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/instrumentation-ball-valves already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulated-tube-clamps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-cabinet-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire/use-for~drop-down-power/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:09 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulating-paint already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulation/flexibility~flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-cable-clamps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/size~18-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/size~45-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulation/shape~rectangular-tube/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulation/shape~ring/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/size~59-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulating-paint already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulation/flexibility~flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-cable-clamps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/size~18-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/size~45-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulation/shape~rectangular-tube/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/insulation/shape~ring/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/size~59-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:31 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-connectors/terminal-material~bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/column-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iowa-flags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-and-steel-ansi-pipe-couplings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-and-steel-hex-socket-pipe-fitting-plugs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-bspt-to-npt-pipe-adapters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-end-caps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-pipe-couplings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-connectors/terminal-material~bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/column-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iowa-flags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-and-steel-ansi-pipe-couplings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-and-steel-hex-socket-pipe-fitting-plugs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-bspt-to-npt-pipe-adapters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-end-caps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-pipe-couplings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:01:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:58 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:01:59 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-loops already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-pipe-tees/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-pipe already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~3-3-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-thumb-nuts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~5-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-wrenches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~no-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-loops already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-pipe-tees/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-pipe already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~3-3-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-thumb-nuts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~5-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/iron-wrenches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~no-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:22 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:27 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-protectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/size~1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-reels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-rods already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-rope-accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/size~19-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-skate-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/ix-industrial-interfaces already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-protectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/size~1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-reels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-rods already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-rope-accessories already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/size~19-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-skate-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/ix-industrial-interfaces already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:50 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:50 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:54 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jackets/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jacks/jack-type~lifting-bag/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-rope-thimbles already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/size~no-34/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-shelving already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-sleeving already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jam-nuts/thread-size~10-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compact-regulators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jackets/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jacks/jack-type~lifting-bag/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-rope-thimbles already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/size~no-34/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-shelving already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wire-sleeving already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jam-nuts/thread-size~10-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compact-regulators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:03:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jam-nuts/thread-size~m14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-u-bolt-mounting-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wireless-phone-chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-wire-brooms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-anchors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-bar-stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compressed-gas-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stencil-ink-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jam-nuts/thread-size~m14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-u-bolt-mounting-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wireless-phone-chargers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-wire-brooms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-anchors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-bar-stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compressed-gas-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stencil-ink-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:43 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:46 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jars/capacity-weight-~18-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-saws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/step-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-screws/drive-style~square/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-screws/length~3-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/computer-carts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/computer-fan-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stepper-motor-gear-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jars/capacity-weight-~18-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-saws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/step-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-screws/drive-style~square/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-screws/length~3-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/computer-carts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/computer-fan-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stepper-motor-gear-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:12 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jig-springs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concentration-meters/for-testing~specific-gravity/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-screws/screw-size~no-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumper-molding/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/joints/connection-type~press-fit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/woodworking-knives already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/color~clear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concrete-nails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jig-springs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concentration-meters/for-testing~specific-gravity/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wood-screws/screw-size~no-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumper-molding/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/joints/connection-type~press-fit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/woodworking-knives already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/color~clear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concrete-nails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:34 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sterilization-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concrete-vibrators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/work-positioners already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jute-cords already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sticky-back-cable-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/workbenches/frame-material~aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/key-locking-insert-tools already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stir-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sterilization-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concrete-vibrators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/work-positioners already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/jute-cords already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sticky-back-cable-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/workbenches/frame-material~aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/key-locking-insert-tools already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stir-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keyed-shafts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~0025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~01122b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~0794/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cone-flashlights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wrenches/finish~zinc-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~1007la/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stop-off-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keyed-shafts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~0025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~01122b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~0794/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cone-flashlights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wrenches/finish~zinc-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~1007la/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stop-off-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:26 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:31 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushing-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~16g020/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/number-of-poles~23/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~23854/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~2526/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~120-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~20-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~a1054wc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushing-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~16g020/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/number-of-poles~23/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~23854/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~2526/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~120-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~20-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~a1054wc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:50 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:51 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:54 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~25-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wyes/pipe-size~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~a520/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wyoming-flags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~b74/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~by11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/xl-series-timing-belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strapping-crimpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~25-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wyes/pipe-size~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~a520/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/wyoming-flags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~b74/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~by11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/xl-series-timing-belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strapping-crimpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:22 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~co87/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~ea47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~0-67-oz-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~1-1-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~100-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~1000-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~10-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~mc6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~co87/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~ea47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~0-67-oz-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~1-1-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~100-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~1000-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~10-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~mc6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:46 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:50 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:51 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straps/material~polyester-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m12-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~p164/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~p177/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stress-analysis-strain-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~p761/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~sc8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~sm22/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straps/material~polyester-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m12-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~p164/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~p177/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stress-analysis-strain-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~p761/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~sc8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~sm22/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:07:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~sm866/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~7-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~y1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stripper-chemicals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~y14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stripping-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/manufacturer~esp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/zip-ties/length~35/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~sm866/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity-weight-~7-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~y1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stripper-chemicals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/key-number~y14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stripping-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/manufacturer~esp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/zip-ties/length~35/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:39 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:43 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/continuous-length-extension-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/butt-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/material~aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/converters/transformer-voltage-function~step-up/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-lacers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-lacing/hook-style~long-leg-ll/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-take-up-frames/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-brush-holders/backing-width~7-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/continuous-length-extension-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/butt-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/keys/material~aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/converters/transformer-voltage-function~step-up/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-lacers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-lacing/hook-style~long-leg-ll/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-take-up-frames/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-brush-holders/backing-width~7-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:09 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:12 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/klip-rings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-guide-mounting-rods/length~400-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/knobs/mount-type~adhesive/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-rollers/between-frame-width~14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-rollers/between-frame-width~21/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/knockout-hole-cutters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/struts/strut-channel-type~curved/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-safety-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/klip-rings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-guide-mounting-rods/length~400-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/knobs/mount-type~adhesive/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-rollers/between-frame-width~14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-rollers/between-frame-width~21/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/knockout-hole-cutters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/struts/strut-channel-type~curved/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-safety-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:31 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:34 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/l-handle-spring-plungers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cooking-thermometers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/subminiature-wedge-base-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coolant-for-coolant-systems/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cooler-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/latch-pins already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/for-knockout-trade-size~m16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~0710-735-001/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/l-handle-spring-plungers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cooking-thermometers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/subminiature-wedge-base-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coolant-for-coolant-systems/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cooler-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/latch-pins already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/for-knockout-trade-size~m16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~0710-735-001/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:08:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:58 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:08:59 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~125-001de/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/surge-tanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/computer-connection-type~db15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~238a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/connection-type~electrical-box/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/suspension-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swage-standoffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/voltage~16v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~125-001de/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/surge-tanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/computer-connection-type~db15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~238a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/connection-type~electrical-box/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/suspension-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swage-standoffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/voltage~16v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:22 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:24 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:26 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:27 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~efp103/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~kn-113/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/core-files/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/actuator-style~finger-touch/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/actuator-style~rocker-with-mini-slide-dimmer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corn-cob-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corner-band-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/certification~enec-marked/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~efp103/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~kn-113/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/core-files/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/actuator-style~finger-touch/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/actuator-style~rocker-with-mini-slide-dimmer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corn-cob-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corner-band-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/certification~enec-marked/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:50 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:51 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:54 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~s52-071/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corrugated-duct/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~1-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~17-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/use-for~panel-and-equipment-hook-up-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cotton-duct-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/ldpe-bar-stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lead-screw-protectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~s52-071/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corrugated-duct/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~1-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~17-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/use-for~panel-and-equipment-hook-up-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cotton-duct-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/ldpe-bar-stock already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lead-screw-protectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:22 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lead-shields already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/counters/unit-of-measure~miles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/countersink-angle~120-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/for-screw-size~5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/led-warning-lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-carrier-mounting-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/left-hand-threaded-cap-screws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/left-hand-threaded-shoulder-bolts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lead-shields already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/counters/unit-of-measure~miles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/countersink-angle~120-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/for-screw-size~5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/led-warning-lights already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-carrier-mounting-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/left-hand-threaded-cap-screws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/left-hand-threaded-shoulder-bolts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:46 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/left-handed-calipers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-glands/environment~corrosive/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/level-detectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/levels/mount-type~threaded-stud/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~2-2a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~28a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/levels/thread-size~1-4-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~resins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/left-handed-calipers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-glands/environment~corrosive/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/level-detectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/levels/mount-type~threaded-stud/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~2-2a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~28a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/levels/thread-size~1-4-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~resins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:12 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~sodium-chloride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/pipe-size~3-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~65-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shape~70-elbow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~1-1-4-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lic1865026cc-batteries already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-voltage~30v-ac-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-shrouds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~sodium-chloride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/pipe-size~3-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~65-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shape~70-elbow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~1-1-4-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lic1865026cc-batteries already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-voltage~30v-ac-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-shrouds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:31 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:39 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-socks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/wire-connection-type~solenoid-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lifts/type~thimble/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivel-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cpc-quick-disconnects/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/base-number~gx24q-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cr1025-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cradle-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-socks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/wire-connection-type~solenoid-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lifts/type~thimble/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivel-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cpc-quick-disconnects/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/base-number~gx24q-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cr1025-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cradle-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:11:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:11:58 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/craftsman-compatible-garage-door-openers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/bulb-shape~pointed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crane-rails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crate-openers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/bulb-shape-number~br30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/creamery-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~2-1-2-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~5-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/craftsman-compatible-garage-door-openers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/bulb-shape~pointed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crane-rails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crate-openers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/bulb-shape-number~br30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/creamery-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~2-1-2-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~5-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:22 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:26 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:27 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crossover-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~m7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~15-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~1157na/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/syringes/capacity~0-005-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crush-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crush-resistant-duct-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crystal-simple-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crossover-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~m7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~15-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~1157na/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/syringes/capacity~0-005-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crush-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crush-resistant-duct-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crystal-simple-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:50 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:54 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~1895b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cup-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caged-needle-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~250q-cl-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~300t3q-cl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~3156/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~ip10-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~t10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~1895b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cup-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caged-needle-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~250q-cl-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~300t3q-cl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~3156/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~ip10-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~t10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/custom-magnetic-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~3423a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~41/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/size~ip25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutoff-wheels-for-metallurgical-testing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~657/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~756/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/custom-magnetic-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~3423a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~41/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/size~ip25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutoff-wheels-for-metallurgical-testing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~657/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~756/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:43 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:46 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~87/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cx120-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slot-framing-component~roller-wheel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~906y/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slot-framing-component~track-roller/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~921/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~939/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/d344-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~87/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cx120-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slot-framing-component~roller-wheel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~906y/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slot-framing-component~track-roller/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~921/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~939/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/d344-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:09 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:14:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/d377-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slotted-framing-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slotted-framing-rails/rail-height~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/camera-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~h7635/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slotted-framing-structural-brackets/material~6560-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-tap-splice-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/density-meters/scale~baume/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/d377-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slotted-framing-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slotted-framing-rails/rail-height~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/camera-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/trade-number~h7635/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slotted-framing-structural-brackets/material~6560-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-tap-splice-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/density-meters/scale~baume/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:31 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t12-light-fixtures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t6-1%2f2-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/voltage~2-5v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/voltage~20v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/depth-gauges/manufacturer-model-number~900367/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/table-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/voltage~48v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/voltage~7v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t12-light-fixtures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t6-1%2f2-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/voltage~2-5v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/voltage~20v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/depth-gauges/manufacturer-model-number~900367/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/table-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/voltage~48v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/voltage~7v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:14:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:58 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:14:59 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tabletop-blenders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/development-board-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tabs/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/development-board-sensor-modules/barcode-type~matrix-2-of-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/development-board-sensor-modules/infrared-sensor-type~thermal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~125w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~13-3w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caps/for-pipe-size~18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tabletop-blenders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/development-board-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tabs/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/development-board-sensor-modules/barcode-type~matrix-2-of-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/development-board-sensor-modules/infrared-sensor-type~thermal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~125w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~13-3w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caps/for-pipe-size~18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:22 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:24 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:26 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:27 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~2-3w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dewalt-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~3-6w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~300w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~30w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~193595g/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tamper-resistant-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/captured-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~2-3w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dewalt-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~3-6w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~300w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~30w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~193595g/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tamper-resistant-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/captured-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:51 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:54 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tamper-resistant-tri-groove-insert-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tank-access/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~7-2w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~657w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-diffusers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbide-tipped-lathe-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~pt05471/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/line-pulleys already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tamper-resistant-tri-groove-insert-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tank-access/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-bulbs/wattage~7-2w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~657w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/light-diffusers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbide-tipped-lathe-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~pt05471/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/line-pulleys already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:16:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diameter-tape-measures/blade-color~yellow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diamond-grit-reciprocating-saw-blades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/linear-translators already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~3-1-2-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/liners/flexibility~very-flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/linkage-arms already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~60-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~8-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diameter-tape-measures/blade-color~yellow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diamond-grit-reciprocating-saw-blades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/linear-translators already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~3-1-2-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/liners/flexibility~very-flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/linkage-arms already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~60-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~8-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:39 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:46 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/liquid-levels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-lifting-tongs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-spring-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity-weight-~20-cu-ft-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dielectric-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loaded-lip-seals already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity-weight-~40-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity-weight-~55-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/liquid-levels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-lifting-tongs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-spring-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity-weight-~20-cu-ft-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dielectric-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loaded-lip-seals already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity-weight-~40-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity-weight-~55-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:09 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:17:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/locker-door-locks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity-weight-~8-fl-oz-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-4-19-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-4-27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-4-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/locking-hinges already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-5-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/locks/manufacturer~wilson-bohannan/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/locker-door-locks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity-weight-~8-fl-oz-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-4-19-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-4-27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-4-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/locking-hinges already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-5-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/locks/manufacturer~wilson-bohannan/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:34 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-16-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-8-11-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-8-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loctite-294 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loctite-3336 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loctite-438 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/differential-pressure-transmitters/communication-protocol~io-link/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-16-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-8-11-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-8-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loctite-294 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loctite-3336 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loctite-438 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/differential-pressure-transmitters/communication-protocol~io-link/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diffusers/for-use-with~water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~16-ft-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/digital-force-scales/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loctite-adhesives already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~5-ft-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-rail-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-rail-mount-circuit-breakers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/catwalk-flooring/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diffusers/for-use-with~water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~16-ft-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/digital-force-scales/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loctite-adhesives already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~5-ft-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-rail-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-rail-mount-circuit-breakers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/catwalk-flooring/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:34 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/manufacturer-model-number~lm1225cme/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loops/sling-type~mesh/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loto-(lockout%2ftagout)-lockouts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/louisiana-flags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/direct-drive-exhaust-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/directional-compasses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taper-pin-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taper-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/manufacturer-model-number~lm1225cme/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loops/sling-type~mesh/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/loto-(lockout%2ftagout)-lockouts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/louisiana-flags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/direct-drive-exhaust-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/directional-compasses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taper-pin-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taper-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:18:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:54 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:58 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:18:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/low-profile-head-machine-screws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dish-racks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/disposable-boots/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/disposable-funnels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tapping-screws/drive-style~drilled-spanner/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lubricants/manufacturer~relton/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/distortion-free-magnifiers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lubricants/open-gear-and-chain-grease-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/low-profile-head-machine-screws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dish-racks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/disposable-boots/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/disposable-funnels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tapping-screws/drive-style~drilled-spanner/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lubricants/manufacturer~relton/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/distortion-free-magnifiers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lubricants/open-gear-and-chain-grease-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:22 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:26 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:27 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-1-16-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lubricants/trade-name~wd-40-specialist-penetrant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cement-cutting-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lubricants already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/center-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/center-locators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lufkin-tape-rulers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dollies/forming-spoons-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-1-16-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lubricants/trade-name~wd-40-specialist-penetrant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cement-cutting-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lubricants already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/center-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/center-locators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lufkin-tape-rulers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dollies/forming-spoons-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:50 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:51 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/m8-connectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/machinable-phenolics already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-alarms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-barricades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~10-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/made-to-order-pipe-markers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnet-cups already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-base-drill-cutting-fluids already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/m8-connectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/machinable-phenolics already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-alarms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-barricades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~10-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/made-to-order-pipe-markers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnet-cups already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-base-drill-cutting-fluids already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:20:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ceramics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-cam-locks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-struts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-lifters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-stickers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-zip-tie-mounts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~9-16-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-angle-milling-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ceramics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-cam-locks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-struts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-lifters already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-stickers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnetic-zip-tie-mounts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~9-16-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-angle-milling-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:43 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:46 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnets/finish~zinc-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-squares/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/makita-circular-saws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mandrels/for-use-with~drill-presses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tarps/material~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-013/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-0313/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/magnets/finish~zinc-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-squares/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/makita-circular-saws already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mandrels/for-use-with~drill-presses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tarps/material~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-013/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-0313/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:12 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:21:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/marine-alloy-aluminum already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/marine-bearings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/marine-switches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/markers/color~black-orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tec-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-and-belt-pulleys/belt-trade-size~xxh/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/markers/color~handicap-blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-and-belt-pulleys/material~steel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/marine-alloy-aluminum already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/marine-bearings already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/marine-switches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/markers/color~black-orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tec-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-and-belt-pulleys/belt-trade-size~xxh/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/markers/color~handicap-blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-and-belt-pulleys/material~steel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:34 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:39 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-102/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/markers/mount-type~hook-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/markers/mount-type~nail-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-1254/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masking-tape/color~green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masking-tape/color~light-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masking-tape/color~orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masks/application~cold-protection/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-102/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/markers/mount-type~hook-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/markers/mount-type~nail-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-1254/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masking-tape/color~green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masking-tape/color~light-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masking-tape/color~orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masks/application~cold-protection/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-182/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masterkleer-tubing already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/material-lifts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/material-stands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mats/material~paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-325/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-425/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/specifications-met~ifgc-compliant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-182/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/masterkleer-tubing already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/material-lifts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/material-stands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mats/material~paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-325/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-425/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/specifications-met~ifgc-compliant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:34 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/construction~perforated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/specifications-met~sae-j2494-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~7-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/thread-type~universal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~12-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/head-type~headless/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~200-200/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/telephone-signal-generators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/construction~perforated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/specifications-met~sae-j2494-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~7-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/thread-type~universal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~12-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/head-type~headless/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~200-200/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/telephone-signal-generators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:22:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:54 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:58 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:22:59 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~31-58/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/telescopic-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~50-50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~56-56/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drain-pan-wicking-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-panel-meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-stickers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-sticks/temperature-points~1200-f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~31-58/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/telescopic-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~50-50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mesh/mesh-size~56-56/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drain-pan-wicking-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-panel-meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-stickers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-sticks/temperature-points~1200-f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:24 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawbars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-sticks/temperature-points~2000-f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-sticks/temperature-points~250-f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawer-slides/closed-length~27-9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawers/drawer-release~button/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-sticks/temperature-points~388-f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dremel-compatible-drilling-tool-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dremel-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawbars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-sticks/temperature-points~2000-f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-sticks/temperature-points~250-f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawer-slides/closed-length~27-9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawers/drawer-release~button/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-sticks/temperature-points~388-f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dremel-compatible-drilling-tool-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dremel-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:50 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:51 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drierite/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-cabinets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temporary-outdoor-shelters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/cobalt-steel-morse-taper-shank-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-0110/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-46-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-48-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/terminal-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drierite/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-cabinets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temporary-outdoor-shelters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/cobalt-steel-morse-taper-shank-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-0110/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-46-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-48-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/terminal-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:12 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:24:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-leads/for-fluke-model-number~1587/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-leads/for-fluke-model-number~789/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~3-95-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~37-ga-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-weights/weight~10-kg/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-weights/weight~5-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~5-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-leads/for-fluke-model-number~1587/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-leads/for-fluke-model-number~789/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~3-95-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~37-ga-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-weights/weight~10-kg/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-weights/weight~5-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~5-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:45 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~50-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tethered-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermal-dynamics-torches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~7-9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermally-conductive-ceramics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/hole-saw-kits-9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/length~220-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/length~5-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~50-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tethered-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermal-dynamics-torches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~7-9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermally-conductive-ceramics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/hole-saw-kits-9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/length~220-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/length~5-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermometers/mounting-location~din-rail/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/maintenance-length-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermostat-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/point-style~brad/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/reduced-shank-drill-bit-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thickness-gauges/manufacturer-model-number~7326a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-27-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-gauges/for-system-of-measurement~inch/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermometers/mounting-location~din-rail/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/maintenance-length-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermostat-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/point-style~brad/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/reduced-shank-drill-bit-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thickness-gauges/manufacturer-model-number~7326a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-27-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-gauges/for-system-of-measurement~inch/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:34 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-measuring-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-sealant-tape/for-use-with~benzene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~17-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~19-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-sealant-tape/for-use-with~sodium-sulfide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~2-65mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~2-8mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~4-15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-measuring-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-sealant-tape/for-use-with~benzene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~17-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~19-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-sealant-tape/for-use-with~sodium-sulfide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~2-65mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~2-8mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~4-15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:25:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:25:58 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:01 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-sealants/manufacturer-model-number~5117/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~6-3-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~6-9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-size~2-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-shank-screwdriver-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threading-die-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threadlocker-sticks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thredolets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-sealants/manufacturer-model-number~5117/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~6-3-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~6-9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-size~2-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-shank-screwdriver-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threading-die-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threadlocker-sticks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thredolets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:24 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:27 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:30 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:31 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/three-phase-disconnects/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/throttle-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thv-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ticket-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tie-down-eyelets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tie-wrap-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tied-wire-hangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/three-phase-disconnects/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/throttle-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thv-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ticket-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tie-down-eyelets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tie-wrap-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tied-wire-hangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:51 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:54 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~28-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~8-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-bodies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-collet-bodies/torch-series-number~17/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-nozzles/tig-industry-number~53n6cn2-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-nozzles/tig-torch-nozzle-size~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-power-cable-adapters/for-torch-series-number~25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tilt-platforms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~28-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~8-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-bodies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-collet-bodies/torch-series-number~17/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-nozzles/tig-industry-number~53n6cn2-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-nozzles/tig-torch-nozzle-size~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-power-cable-adapters/for-torch-series-number~25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tilt-platforms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:17 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:22 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:23 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tilt-stages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tilt-to-roll-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timers/mounting-location~din-rail/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timing-belt-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timing-belt-end-plates/belt-trade-size~at10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timing-belts/belt-trade-number~16-at10-890/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timing-belts/belt-trade-number~25-at10-800/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tinners'-snips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tilt-stages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tilt-to-roll-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timers/mounting-location~din-rail/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timing-belt-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timing-belt-end-plates/belt-trade-size~at10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timing-belts/belt-trade-number~16-at10-890/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timing-belts/belt-trade-number~25-at10-800/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tinners'-snips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:43 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:44 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:46 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:47 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:48 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:49 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-repair-kits/for-tire-style~tubeless/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-repair-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-spoons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-valve-extensions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tl-2300-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toggle-bolts/fastener-head-type~rounded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toggle-switch-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toilet-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-repair-kits/for-tire-style~tubeless/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-repair-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-spoons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-valve-extensions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tl-2300-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toggle-bolts/fastener-head-type~rounded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toggle-switch-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toilet-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:09 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:10 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:11 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:13 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:28:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:14 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:15 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:16 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toilet-tank-replacement-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tongs/environment~food-and-beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-stripes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/capacity-weight-~9-1-4-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/touch-up-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/traction-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trailer-balls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toilet-tank-replacement-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tongs/environment~food-and-beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-stripes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/capacity-weight-~9-1-4-gal-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/touch-up-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/traction-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trailer-balls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:36 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:38 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:40 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:41 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:42 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/traps/for-use-with~petroleum-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-compactor-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-container-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/travel-cases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tri-fold-rivets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tri-groove-head-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/triacetate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trip-guards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/traps/for-use-with~petroleum-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-compactor-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-container-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/travel-cases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tri-fold-rivets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tri-groove-head-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/triacetate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trip-guards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:00 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:02 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:03 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:04 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:08 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tripod-masts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trolleys/strut-channel-trolleys-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-benders/for-use-on~titanium/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/for-use-with~xylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-sampling-ports/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/flammability-rating~ul-94-v-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/material~santoprene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~6-3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tripod-masts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trolleys/strut-channel-trolleys-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-benders/for-use-on~titanium/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/for-use-with~xylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-sampling-ports/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/flammability-rating~ul-94-v-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/material~santoprene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~6-3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:25 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:26 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:27 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:28 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:29 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:31 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:32 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:33 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/specifications-met~astm-d3296/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/specifications-met~sae-j844-type-a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tungsten-carbide-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turcite-x/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turner%27s-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turntables/shape~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turret-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/color~blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/specifications-met~astm-d3296/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/specifications-met~sae-j844-type-a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tungsten-carbide-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turcite-x/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turner%27s-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turntables/shape~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turret-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/color~blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:29:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:51 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:52 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:53 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:55 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:56 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:58 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:29:59 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/color~red/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/safety-properties~electrically-insulating/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/tweezer-trade-number~572/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/tweezer-trade-number~5b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/twin-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/type-12-grinding-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ultem-plastic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ultraviolet-lamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/color~red/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/safety-properties~electrically-insulating/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/tweezer-trade-number~572/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezers/tweezer-trade-number~5b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-12-27 23:30:13 [scrapy.extensions.closespider] (PID: 126) INFO: Closing spider since no items were produced in the last 1800 seconds. 2025-12-27 23:30:13 [scrapy.core.engine] (PID: 126) INFO: Closing spider (closespider_timeout_no_item) 2025-12-27 23:30:13 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-12-27 23:30:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:20 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:21 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 407, 'reason': b'Auth failed'}] 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... FAIL 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... FAIL 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... FAIL 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... FAIL 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... FAIL 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] ====================================================================== FAIL: Extracted Items Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 177, in test_stat_monitor self.fail(message) AssertionError: Unable to find 'item_scraped_count' in job stats. 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] ====================================================================== FAIL: Error Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/ERROR' to be '<=' to '0.0'. Current value: '1096' 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] ====================================================================== FAIL: Warning Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '1102' 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] ====================================================================== FAIL: Finish Reason Monitor/Should have the expected finished reason(s) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 110, in test_should_finish_with_expected_reason self.assertTrue(finished_reason in expected_reasons, msg=msg) AssertionError: Finished with "closespider_timeout_no_item" the expected reasons are ['finished'] 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] ====================================================================== FAIL: Field Coverage Monitor/test_check_if_field_coverage_rules_are_met ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 477, in test_check_if_field_coverage_rules_are_met self.assertTrue(len(failures) == 0, msg=msg) AssertionError: The following items did not meet field coverage rules: dict/inStock (expected 1.0, got 0) dict/name (expected 1.0, got 0) dict/prices (expected 1.0, got 0) dict/productStatus (expected 1.0, got 0) dict/supplier (expected 1.0, got 0) dict/supplierSku (expected 1.0, got 0) dict/url (expected 1.0, got 0) 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] ====================================================================== FAIL: Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 282, in test_maximum_retries self.assertLessEqual(max_reached, threshold, msg=msg) AssertionError: Too many requests (548) reached the maximum retry amount 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] ====================================================================== FAIL: Downloader Exceptions monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'downloader/exception_count' to be '<=' to '100.0'. Current value: '1652' 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] 11 monitors in 0.006s 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] FAILED (failures=7, skipped=1) 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] 0 actions in 0.000s 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] OK 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] 0 actions in 0.000s 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] OK 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... ERROR 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] ====================================================================== ERROR: CustomTemplateSendSlackMessageSpiderFinished ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/core/actions.py", line 39, in run self.run_action() File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 252, in run_action self.manager.send_message( File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 58, in send_message return [ ^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 59, in self.send_message( File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 85, in send_message return self._send_channel_message( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 129, in _send_channel_message attachments=self._parse_attachments(attachments), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 171, in _parse_attachments python_attachments = ast.literal_eval(attachments) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/ast.py", line 64, in literal_eval node_or_string = parse(node_or_string.lstrip(" \t"), mode='eval') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/ast.py", line 50, in parse return compile(source, filename, mode, flags, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "", line 4 "text": "• _Extracted Items Monitor/test_stat_monitor_: Unable to find 'item_scraped_count' in job stats.\n• _Error Count Monitor/test_stat_monitor_: Expecting 'log_count/ERROR' to be '<=' to '0.0'. Current value: '1096'\n• _Warning Count Monitor/test_stat_monitor_: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '1102'\n• _Finish Reason Monitor/Should have the expected finished reason(s)_: Finished with "closespider_timeout_no_item" the expected reasons are ['finished']\n• _Field Coverage Monitor/test_check_if_field_coverage_rules_are_met_: ^ SyntaxError: unterminated string literal (detected at line 4) 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] 1 action in 0.222s 2025-12-27 23:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] FAILED (errors=1) 2025-12-27 23:30:22 [scrapy.utils.signal] (PID: 126) ERROR: Error caught on signal handler: > Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1253, in adapt extracted: _SelfResultT | Failure = result.result() ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/extensions/feedexport.py", line 504, in close_spider self._close_slot(slot, spider) File "/usr/local/lib/python3.11/site-packages/scrapy/extensions/feedexport.py", line 535, in _close_slot d: Deferred[None] = maybeDeferred(slot.storage.store, get_file(slot)) # type: ignore[call-overload] ^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/extensions/feedexport.py", line 517, in get_file assert slot_.file ^^^^^^^^^^ AssertionError 2025-12-27 23:30:22 [scrapy.statscollectors] (PID: 126) INFO: Dumping Scrapy stats: {'HeadersSpooferDownloaderMiddleware/session/created': 552, 'HeadersSpooferDownloaderMiddleware/session/spoofed': 1652, 'big_query/url': 552, 'downloader/exception_count': 1652, 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 1652, 'downloader/request_bytes': 1371529, 'downloader/request_count': 1652, 'downloader/request_method_count/GET': 1652, 'elapsed_time_seconds': 1808.357768, 'finish_reason': 'closespider_timeout_no_item', 'finish_time': datetime.datetime(2025, 12, 27, 23, 30, 22, 51430, tzinfo=datetime.timezone.utc), 'items_per_minute': None, 'log_count/ERROR': 1105, 'log_count/INFO': 73, 'log_count/WARNING': 1102, 'memusage/max': 261619712, 'memusage/startup': 126320640, 'proxy_manager/processed': 1652, 'proxy_manager/session_attached': 1652, 'responses_per_minute': None, 'retry/count': 1104, 'retry/max_reached': 548, 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 1104, 'scheduler/dequeued': 1652, 'scheduler/dequeued/memory': 1652, 'scheduler/enqueued': 1656, 'scheduler/enqueued/memory': 1656, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'start_requests/big_query': 552, 'start_time': datetime.datetime(2025, 12, 27, 23, 0, 13, 693662, tzinfo=datetime.timezone.utc)} 2025-12-27 23:30:22 [scrapy.core.engine] (PID: 126) INFO: Spider closed (closespider_timeout_no_item)