2026-01-24 23:00:12 [scrapy.utils.log] (PID: 101) INFO: Scrapy 2.12.0 started (bot: catalog_extraction) 2026-01-24 23:00:12 [scrapy.utils.log] (PID: 101) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36 2026-01-24 23:00:12 [mcmaster_carr] (PID: 101) INFO: Starting extraction spider mcmaster_carr... 2026-01-24 23:00:12 [scrapy.addons] (PID: 101) INFO: Enabled addons: [] 2026-01-24 23:00:12 [py.warnings] (PID: 101) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting. It will be removed in a future version of Scrapy. return cls(crawler) 2026-01-24 23:00:12 [scrapy.extensions.telnet] (PID: 101) INFO: Telnet Password: b5f403000f5ebe64 2026-01-24 23:00:12 [py.warnings] (PID: 101) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2026-01-24 23:00:13 [scrapy.middleware] (PID: 101) INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.closespider.CloseSpider', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon'] 2026-01-24 23:00:13 [scrapy.crawler] (PID: 101) INFO: Overridden settings: {'BOT_NAME': 'catalog_extraction', 'CONCURRENT_ITEMS': 250, 'CONCURRENT_REQUESTS': 8, 'DOWNLOAD_DELAY': 0.9, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/mcmaster_carr/6c8748d2f97811f0a5d64200a9fe0102.log', 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: ' '%(message)s', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'catalog_extraction.spiders', 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter', 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 522, 524, 408, 429, 420], 'SPIDER_MODULES': ['catalog_extraction.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': None} 2026-01-24 23:00:13 [scrapy_poet.injection] (PID: 101) INFO: Loading providers: [, , , , , , ] 2026-01-24 23:00:13 [scrapy.middleware] (PID: 101) INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware', 'scrapy_poet.InjectionMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy_poet.DownloaderStatsMiddleware'] 2026-01-24 23:00:13 [NotFoundHandlerSpiderMiddleware] (PID: 101) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment. 2026-01-24 23:00:13 [scrapy.middleware] (PID: 101) INFO: Enabled spider middlewares: ['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware', 'catalog_extraction.middlewares.FixtureSavingMiddleware', 'scrapy_poet.RetryMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-01-24 23:00:13 [scrapy.middleware] (PID: 101) INFO: Enabled item pipelines: ['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline', 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline', 'catalog_extraction.pipelines.PriceRoundingPipeline', 'scraping_utils.pipelines.AttachSupplierPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline'] 2026-01-24 23:00:13 [scrapy.core.engine] (PID: 101) INFO: Spider opened 2026-01-24 23:00:13 [scrapy.extensions.closespider] (PID: 101) INFO: Spider will stop when no items are produced after 1800 seconds. 2026-01-24 23:00:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:00:13 [scrapy.extensions.telnet] (PID: 101) INFO: Telnet console listening on 127.0.0.1:6023 2026-01-24 23:00:19 [ProxyManagerDownloaderMiddleware] (PID: 101) INFO: Using brd-customer-hl_13cda1e4-zone-sharedpool_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware. 2026-01-24 23:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire/diameter~9-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~m10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire/cable-designation~fplr/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~m20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steam-needle-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steamostats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~9-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-(schedule-80)-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~fplr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collapsible-wire-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~m20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001541924%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:52 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/wire/industry-designation~fplr/ 2026-01-24 23:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cold-rolled-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire/cable-designation~stw/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire/length~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/instrumentation-ball-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire/flammability-rating~ul-2556-ft4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collar-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/length~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 41 pages (at 41 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/insulated-tube-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~stw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~17-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001628588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/length~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=instrumentation-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:27 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/wire/industry-designation~stw/ 2026-01-24 23:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/specifications-met~flame-rated-ft4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003311995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001597104%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulated-tube-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:36 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/wire/specifications-met~flame-rated-ft4/ 2026-01-24 23:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/insulating-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-cabinet-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire/mcm-wire-size~500-mcm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/insulation/for-use-on~grout/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:55 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire-baskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulating-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/wire-gauge~500-mcm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~18-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~grout&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:06 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/collet-size~5mm/ 2026-01-24 23:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:09 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/wire/wire-gauge~500-mcm/ 2026-01-24 23:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 88 pages (at 47 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/insulation/shape~film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/insulation/shape~ring/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-baskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~59-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire-cable-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~18-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7770A27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227770A27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:30 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/size~18-mm/ 2026-01-24 23:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/shape~film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/shape~ring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~59-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:37 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/insulation-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-cable-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-hex-head-tapping-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7770A27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227770A27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:45 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/size~59-64/ 2026-01-24 23:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bubble-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/flags/u-s-state-territory~iowa/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/iron-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire-marking-decals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7770A27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227770A27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/iron-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=colored-grease-gun-bands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 136 pages (at 48 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/thumb-nuts/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:16 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iowa-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-marking-decals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:21 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/roller-chain/chain-standard~iso/roller-chain-trade-number~08b-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~1-11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~5-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire-protectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-thumb-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/iso-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire-retainers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3236610467807&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=combination%20wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3236610467807%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-08b-2-roller-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~1-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire-rope-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:03:57 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~1-11-16/ 2026-01-24 23:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-retainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/hose-fittings/quick-disconnect-style~iso-series-b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/iso-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/jackets/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wire-rope-sheaves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 177 pages (at 41 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~no-11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-shot&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-series-b-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~no-34/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-sheaves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~1-2-28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~10-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~no-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~15-32-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~no-34&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:41 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~no-11/ 2026-01-24 23:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:44 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~no-34/ 2026-01-24 23:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compact-arbor-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-2-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~10-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~15-32-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-u-bolt-mounting-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000139805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453843%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkhead-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkhead-tank-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:05 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-2-28&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:05:07 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~10-32&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:05:08 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~15-32-32&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air-filter%252flubricators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 223 pages (at 46 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/jancy-slugger-magnetic-base-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-wire-brooms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stellite-cobalt-6b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-force-gauge-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wood-screws/length~3-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-sleeve-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/jaws/jaw-texture~serrated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/jam-nuts/thread-size~m26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=step-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jancy-slugger-magnetic-base-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wood-screws/screw-size~no-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~m26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wood-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/length~3-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jaws/jaw-texture~serrated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motor-gear-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001630299%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979038566398&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979038566398%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083578%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stereoscopes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/screw-size~no-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/work-positioners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/workbench-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334626%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/kevlar-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/workbench-supports/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 268 pages (at 45 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/kevlar-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=work-positioners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conductivity-solutions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbench-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/iron-wrenches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kevlar-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/workbenches/adjustability~adjustable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbench-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kevlar-fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/workbenches/mobility~mobile/top-material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/workbenches/frame-material~aluminum-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbenches/adjustability~adjustable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sticky-back-cable-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:47 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stock/material~pps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8316204383934&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8316204383934%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001485466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1007la/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbenches/mobility~mobile/top-material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbenches/frame-material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stones/color~blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995947086760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stock&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995947086760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001541260%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-compression-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8316204383934&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8316204383934%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000109595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:06 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/workbenches/frame-material~aluminum/ 2026-01-24 23:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951022873847&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stones&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951022873847%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wrenches/material~aluminum-magnesium/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1906T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221906T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~1007la&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stop-off-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 316 pages (at 48 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wrenches/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:20 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~1007la/ 2026-01-24 23:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/iron-wrenches already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~chlorine&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~12g056/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/material~aluminum-magnesium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1906T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221906T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:29 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-24 23:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:29 [scrapy.core.scraper] (PID: 101) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-24 23:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~16g020/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~grain-alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~sulfur-tetrafluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~17r79/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179313%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:42 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/material~steel/ 2026-01-24 23:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:45 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/material~aluminum-magnesium&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1906T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221906T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~16g020&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~12g056&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/connectors/number-of-poles~17/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4983N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224983N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~2344/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/connectors/nema-type~l7-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~17r79&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401621%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:06 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400670%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/number-of-poles~17-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 362 pages (at 46 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4983N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224983N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~2344&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/nema-style~l7-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:20 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/connectors/number-of-poles~17-1/ 2026-01-24 23:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:24 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/connectors/nema-style~l7-15/ 2026-01-24 23:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/specifications-met~en-1057&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~36247/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/specifications-met~nas1564j12-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4983N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224983N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~3975/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/thread-type~anpt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115331%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132581%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~10000-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102042%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~36247&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:49 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3948N275&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223948N275%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3975&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K163&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K163%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086555%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~130-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400525%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:08:56 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401256%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106927%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~53684/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3948N275&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223948N275%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K163&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K163%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/fitting-connection~barbed-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 414 pages (at 52 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~a1054wc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/write-on-tags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~53684&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3948N275&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223948N275%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K163&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K163%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~a1054wc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~a1515/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=write-on-tags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A191&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A191%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:46 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~a1054wc/ 2026-01-24 23:09:47 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:09:48 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~am935/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~a1515&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/hazard-lights/bulb-type~xenon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:00 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:10:01 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/xl-series-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A191&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A191%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/material~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:07 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~a1515/ 2026-01-24 23:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 463 pages (at 49 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~am935&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=xenon-hazard-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~60-qt/capacity~15-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~65-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=xl-series-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A191&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A191%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:23 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400732%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strapping-crimpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003484286%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140146%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143619%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/y-splitters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~k102/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:42 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/containers/capacity~1000-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number~mc6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~8-1-4-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strapping-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/straps/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=y-splitters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/containers/capacity~32-cu-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stress-analysis-strain-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~k102&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~1000-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:05 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~8-1-4-gal&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~r1064e/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:09 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~k102/ 2026-01-24 23:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~32-cu-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:12 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~1000-ml/ 2026-01-24 23:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/containers/capacity~350-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 512 pages (at 49 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002399097%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:16 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/straps/material~brass/ 2026-01-24 23:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/zip-ties/overall-length~1-15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/containers/capacity~22-qt/capacity~5-5-gal/capacity~5-1-2-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:18 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~32-cu-ft-/ 2026-01-24 23:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~r1064e&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strike-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/containers/capacity~7-1-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~2-3-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~350-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~y1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=string-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:34 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~r1064e/ 2026-01-24 23:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~1-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~5-1-2-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:40 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~350-gal-/ 2026-01-24 23:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/containers/capacity~80-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/containers/capacity~88-fl-oz/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001617834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~7-1-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~2-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:48 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~5-1-2-gal-/ 2026-01-24 23:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~y1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:55 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~7-1-gal-/ 2026-01-24 23:11:56 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/zip-ties/length~2-3-16/ 2026-01-24 23:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/manufacturer-equivalent~chicago/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:11:58 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~y1/ 2026-01-24 23:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~80-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~9-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~88-fl-oz-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/manufacturer-equivalent~esp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001617834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:10 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~80-gal-/ 2026-01-24 23:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:12 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~9-ml/ 2026-01-24 23:12:13 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~88-fl-oz-/ 2026-01-24 23:12:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 557 pages (at 45 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/manufacturer~chicago&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stroke-counters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~8-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=contoured-surface-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/manufacturer~esp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001617834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001612166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:26 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/manufacturer~chicago/ 2026-01-24 23:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=control-panel-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=convex-radius-end-mills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:33 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/manufacturer~esp/ 2026-01-24 23:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/width~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keys/width~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/keystone-jacks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~8-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:43 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/knives/for-use-on~ptfe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591276%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/knobs/grip-style~smooth/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-brush-holders/backing-width~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~4-000mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-covers/food-industry-standard~fda-compliant-21-cfr-181-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=button-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keystone-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5546066553624&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brush%20holders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5546066553624%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:02 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/width~20mm/ 2026-01-24 23:13:04 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/keys/width~4-000mm/ 2026-01-24 23:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5922932339759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20covers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5922932339759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126120%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knives/for-use-on~ptfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/knobs/handle-style~edge-pull/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/grip-style~smooth&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 607 pages (at 50 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:14 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-covers/food-industry-standard~fda-compliant-21-cfr-181-32&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509304%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-roller-covers/color~gray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/knurled-cup-point-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/between-frame-width~31&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=struts/material~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/between-frame-width~32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3857A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223857A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/handle-style~edge-pull&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=struts/strut-channel-type~curved&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6065334404961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20roller%20covers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6065334404961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1360744530601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1360744530601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000019942%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2427054843101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=struts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2427054843101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1360744530601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1360744530601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2427054843101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=struts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2427054843101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982033%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5872K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225872K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knurled-cup-point-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3857A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223857A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/roller-finish~polyethylene-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/knurls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1360744530601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1360744530601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002219666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/lags/screw-size~m6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5872K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225872K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3857A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223857A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyors/between-frame-width~4-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2210T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222210T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cooler-curtains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 660 pages (at 53 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knurls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=951457901010&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B951457901010%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000090070%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lags/screw-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5872K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225872K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:26 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5677K75&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225677K75%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2210T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222210T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9974560404121&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9974560404121%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-knob-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:41 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:14:42 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-alloy-175&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:43 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-push-to-connect-tube-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5677K75&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225677K75%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2210T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222210T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/box-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/cord-grips/enclosure-rating~nema-6p/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/lathe-soft-jaws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-tube-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/american-wire-gauge-awg~22&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/lathes/cut-type~face-knurling/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5677K75&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225677K75%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:05 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latches/draw-locks-and-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/environmental-rating~nema-6p&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-series~waterfree/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 712 pages (at 52 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lathe-soft-jaws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lathes/cut-type~face-knurling&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:18 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/latches/draw-locks-and-latches/ 2026-01-24 23:15:19 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/cord-grips/environmental-rating~nema-6p/ 2026-01-24 23:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:20 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/thread-size~m16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/surveyors-transits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2919599794209&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2919599794209%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002279970%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/power-strips/electrical-protection-type~surge-suppression/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/cords/connects-to~electrical-box/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/for-manufacturer-series~waterfree&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3111105495877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cord%20grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3111105495877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~4921-001-299/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1617N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221617N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:35 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/lavatory-equipment/for-manufacturer-series~waterfree/ 2026-01-24 23:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7310K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227310K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surveyors%27-transits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/connection-type~electrical-box&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~8180-1-0-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surge-suppressor-power-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~4921-001-299&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/computer-connection-type~db15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1617N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221617N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:51 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/connection-type~electrical-box/ 2026-01-24 23:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~l14-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7310K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227310K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098454%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453085%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~8180-1-0&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/lathes/cut-type~knurling/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1617N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221617N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/nema-style~l14-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7310K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227310K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:10 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~8180-1-0/ 2026-01-24 23:16:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 760 pages (at 48 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=core-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453085%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:17 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/nema-style~l14-30/ 2026-01-24 23:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:23 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~s05-054c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=core-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:25 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corn-cob-abrasive-blasting-media&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/switches/panel-cutout-diameter~3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453085%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/counters/measurement-unit~meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrugated-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~s05-054c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/counters/measurement-unit~miles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/leather-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/for-panel-cutout-diameter~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:46 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counters/unit-of-measure~meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/led-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:52 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~3-8/ 2026-01-24 23:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counters/unit-of-measure~miles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:56 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/counters/unit-of-measure~meters/ 2026-01-24 23:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/leds/light-technology~led/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leather-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-carrier-mounting-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/lathes/cut-type~knurling/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:03 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/counters/unit-of-measure~miles/ 2026-01-24 23:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/left-hand-threaded-jam-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=led-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/left-handed-calipers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 804 pages (at 44 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/level-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=LEDs/light-technology~led&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/level-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-threaded-jam-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948839639468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948839639468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-handed-calipers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=level-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=level-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/leveling-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~2-2-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~13-5v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~200-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~hydrogen-fluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leveling-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~methyl-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~2-2a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965331%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:53 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/switching-current~2-2a/ 2026-01-24 23:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~200a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A515&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A515%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/left-hand-drill-bit-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:59 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-24 23:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:17:59 [scrapy.core.scraper] (PID: 101) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-24 23:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~1-2-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A671&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A671%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:00 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/switching-current~200a/ 2026-01-24 23:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~petroleum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~1-5-16-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A515&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A515%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-2-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 849 pages (at 45 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A671&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A671%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-5-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5428K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225428K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-drill-bit-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449455%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A515&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A515%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-glands/environment~corrosive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A671&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A671%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3277K89&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223277K89%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5428K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225428K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6782425493977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20glands&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6782425493977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:36 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~6-3-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-diameter~3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:44 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3277K89&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223277K89%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5428K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225428K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623337%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~65-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000068691%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~65-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/levels/thread-size~5-8-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001584912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2464K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222464K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3277K89&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223277K89%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:01 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623337%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~65a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/levels/thread-size~5-8-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6323T92&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226323T92%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~1-20-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:12 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/switching-current~65a/ 2026-01-24 23:19:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 899 pages (at 50 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shape~270-bend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~5-8-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2464K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222464K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:19 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623337%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310632%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6323T92&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226323T92%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/switches/electrical-connection~din-valve-connection/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~1-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~3-4-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1906N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221906N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~5-8-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~9-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2464K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222464K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:38 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/thread-size~1-20/ 2026-01-24 23:19:40 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6323T92&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226323T92%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/wire-connection-type~solenoid-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93023A663&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293023A663%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1906N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221906N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:19:56 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:19:57 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/wire-connection-type~solenoid-connectors/ 2026-01-24 23:19:58 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~9-16-12&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-type~npsc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coveralls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:01 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:05 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~e39/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~g5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121647%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 950 pages (at 51 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93023A663&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293023A663%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape~pointed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1906N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221906N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpc-quick-disconnects&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=46685K261&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2246685K261%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cradle-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-number~e39&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-number~g5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93023A663&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293023A663%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape~pointed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:34 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:20:35 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/base-number~e39/ 2026-01-24 23:20:36 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/base-number~g5/ 2026-01-24 23:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=46685K261&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2246685K261%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape-number~par30-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000137786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~1-7-8-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crane-trolleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=creamery-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:47 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimpers/for-use-with~smooth-polyester-strapping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=46685K261&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2246685K261%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape-number~par30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~1-7-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crimpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964857%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1156dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:05 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/bulb-shape-number~par30/ 2026-01-24 23:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:09 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/swivels/thread-size~1-7-8-12/ 2026-01-24 23:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~10-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:12 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:21:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 999 pages (at 49 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/faucet-stems/for-manufacturer~symmons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~19-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1156dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:26 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1156dc/ 2026-01-24 23:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/drive-size~2-1-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1665if/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=symmons-faucet-stems&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~19-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:33 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/drive-size~2-1-8-1/ 2026-01-24 23:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/drive-size~19-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:38 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/size~19-mm/ 2026-01-24 23:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1665if&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5933689897561&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crowfeet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5933689897561%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/syringes/capacity~0-05-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crusher-compactors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crushers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:49 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1665if/ 2026-01-24 23:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~m7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringes/capacity-weight-~0-05-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~250q-cl-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5933689897561&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crowfeet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5933689897561%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:04 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3156/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cup-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3156ll/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:09 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/syringes/capacity-weight-~0-05-ml/ 2026-01-24 23:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1043 pages (at 44 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~250q-cl-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3156&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=custom-magnetic-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5933689897561&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crowfeet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5933689897561%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3156ll&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cut-resistant-chaps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:26 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~250q-cl-dc/ 2026-01-24 23:22:27 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~3156/ 2026-01-24 23:22:31 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~3156ll/ 2026-01-24 23:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cut-to-length-rtd-probes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~41/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~ip27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~53r/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:40 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~657/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~631/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/size~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~41&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/size~ip27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~53r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-seal-weatherstripping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:56 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/t-handles/size~11-16/ 2026-01-24 23:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:22:58 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~41/ 2026-01-24 23:22:59 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/t-handles/size~ip27/ 2026-01-24 23:23:00 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~53r/ 2026-01-24 23:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~657&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~flexible-tiles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~631&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~756/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:09 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~657/ 2026-01-24 23:23:10 [scrapy.core.downloader.handlers.http11] (PID: 101) WARNING: Got data loss in https://www.mcmaster.com/products/swivels/thread-size~m7/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-24 23:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~881/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~m7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:13 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~631/ 2026-01-24 23:23:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1088 pages (at 45 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~mat-board&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/bracket-type~corner&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~flexible-tile&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~9003/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/crane-rails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~756&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930408%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561555%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:25 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/cutters/for-use-on~flexible-tile/ 2026-01-24 23:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutting-tweezers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~881&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:30 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~756/ 2026-01-24 23:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47065T236&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247065T236%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~track-roller/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:36 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~881/ 2026-01-24 23:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~9003&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~917/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~b1a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crane-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~d344/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:47 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~9003/ 2026-01-24 23:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~epx/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47065T236&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247065T236%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~track-roller&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~917&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~b1a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=d344-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:02 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~track-roller/ 2026-01-24 23:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~epx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=damper-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:06 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~917/ 2026-01-24 23:24:07 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~b1a/ 2026-01-24 23:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47065T236&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247065T236%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dark-thread-cutting-oils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:12 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~epx/ 2026-01-24 23:24:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1136 pages (at 48 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~fc12t9-d/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~fp28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:20 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: tunnel connect timeout'}] 2026-01-24 23:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-latches/specifications-met~en-45545&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:20 [scrapy.core.scraper] (PID: 101) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: tunnel connect timeout'}] 2026-01-24 23:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:24 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-lock-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~q50t4-cl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2104451082401&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cam%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2104451082401%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004996493%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=camera-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~fc12t9-d&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-rails/t-slotted-framing-rail-profile~quad&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~fp28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=decorative-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=80625A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2280625A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:41 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~fc12t9-d/ 2026-01-24 23:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001463636%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:43 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~fp28/ 2026-01-24 23:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~18v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t12-light-fixtures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~q50t4-cl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~2-5v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/tables/top-weight-capacity~not-rated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:24:57 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~q50t4-cl/ 2026-01-24 23:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=80625A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2280625A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=depth-gauges/manufacturer-model-number~900367&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/board-holders/compartment-type~development-board/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~18v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/10-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~2-5v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8692897390024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=depth%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8692897390024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002087517%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1182 pages (at 46 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tables/top-capacity~not-rated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tachometer-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=80625A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2280625A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553741%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-board-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T05&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T05%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:21 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/tables/top-capacity~not-rated/ 2026-01-24 23:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~10w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K555&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K555%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~12-5-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:31 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~10w/ 2026-01-24 23:25:33 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/125-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tack-cloths&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~1-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T05&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T05%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~0-059-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K555&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K555%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~12-5w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-boards/manufacturer-model-number~mkr-vidor-4000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/15-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~125w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:57 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~12-5w/ 2026-01-24 23:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/for-pipe-size~1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T05&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T05%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:25:59 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/development-boards/manufacturer-model-number~mkr-vidor-4000/ 2026-01-24 23:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K555&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K555%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:04 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~125w/ 2026-01-24 23:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:05 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/caps/for-pipe-size~1-16/ 2026-01-24 23:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~0-059w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/250-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~15w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1229 pages (at 47 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tag-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:14 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:26:16 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~0-059w/ 2026-01-24 23:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dewalt-die-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:17 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:19 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~15w/ 2026-01-24 23:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/30-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-evident-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~320-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~250w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tangless-helical-insert-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:35 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~250w/ 2026-01-24 23:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~8-25-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~513-443-16t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~30w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tacky-surface-dusters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/tank-gauges/mounting-position~vertical/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~320w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~676-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:47 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~30w/ 2026-01-24 23:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:50 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~320w/ 2026-01-24 23:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/light-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083519%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~708bcz&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~8-25w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-gauges/mounting-orientation~vertical&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:01 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~676-3&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141067%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:04 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~8-25w/ 2026-01-24 23:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/linear-motion-carriages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:06 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/tank-gauges/mounting-orientation~vertical/ 2026-01-24 23:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~pt07137&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-snap-gauges/container-type~case&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-fiber-composites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1283 pages (at 54 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140541%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2998991788109&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20snap%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2998991788109%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122531%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/linear-shaft-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-motion-carriages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diameter-tape-measures/length~6-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~18-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/linear-translators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7128674698592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=diameter%20tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7128674698592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618631%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135431%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-shaft-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~23-1-2-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diaphragm-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~14-1-2-qt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-lifting-tongs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-translators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083803%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/litter-pickup-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~28-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loaded-lip-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/locker-door-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~14-1-2-qt-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1329 pages (at 46 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=litter-pickup-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:15 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~14-1-2-qt-/ 2026-01-24 23:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-4-19-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~28-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carrier-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loaded-lip-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locker-door-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/for-use-with~epoxy&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:25 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~28-gal-/ 2026-01-24 23:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454311%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/locks/for-use-on~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179291%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/locks/keying~keyed-differently/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/for-use-with~formaldehyde&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/locks/manufacturer~wilson-bohannan/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/locks/material~fabric-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7819T26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227819T26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968108%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/for-use-on~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/keying~keyed-differently&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/manufacturer~wilson-bohannan&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~5-16-24-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/material~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:55 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/locks/for-use-on~wood/ 2026-01-24 23:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7819T26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227819T26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002066978%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334704%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:02 [mcmaster_carr] (PID: 101) WARNING: no value.entitites: https://www.mcmaster.com/locks/material~fabric/ 2026-01-24 23:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loctite-294/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loctite-325/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~5-8-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1378 pages (at 49 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7819T26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227819T26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loctite-382/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-294&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-325&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~9-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=differential-pressure-transmitters/communication-protocol~io-link&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-height-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:31 [scrapy.downloadermiddlewares.retry] (PID: 101) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-24 23:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loctite-9462/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6547774720592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=differential%20pressure%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6547774720592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982379%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-382&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loctite-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loctite-caulk/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/locking-panel-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loctite-no-more-leaks-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/products/loctite-underwater-epoxy-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-3861-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-9462&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-caulk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~l1035c-02&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=catwalk-flooring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-no-more-leaks-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-underwater-epoxy-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004931577%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 101) WARNING: Request https://www.mcmaster.com/mv1769032333/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-24 23:30:13 [scrapy.extensions.closespider] (PID: 101) INFO: Closing spider since no items were produced in the last 1800 seconds. 2026-01-24 23:30:13 [scrapy.core.engine] (PID: 101) INFO: Closing spider (closespider_timeout_no_item) 2026-01-24 23:30:13 [scrapy.extensions.logstats] (PID: 101) INFO: Crawled 1426 pages (at 48 pages/min), scraped 0 items (at 0 items/min) 2026-01-24 23:30:20 [scrapy.core.scraper] (PID: 101) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1769032333/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~l1035c-02&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... FAIL 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... FAIL 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... FAIL 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... OK 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... OK 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] ---------------------------------------------------------------------- 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) ERROR: [Spidermon] ====================================================================== FAIL: Extracted Items Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 177, in test_stat_monitor self.fail(message) AssertionError: Unable to find 'item_scraped_count' in job stats. 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) ERROR: [Spidermon] ====================================================================== FAIL: Error Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/ERROR' to be '<=' to '0.0'. Current value: '57' 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) ERROR: [Spidermon] ====================================================================== FAIL: Warning Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '1380' 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) ERROR: [Spidermon] ====================================================================== FAIL: Finish Reason Monitor/Should have the expected finished reason(s) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 110, in test_should_finish_with_expected_reason self.assertTrue(finished_reason in expected_reasons, msg=msg) AssertionError: Finished with "closespider_timeout_no_item" the expected reasons are ['finished'] 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) ERROR: [Spidermon] ====================================================================== FAIL: Field Coverage Monitor/test_check_if_field_coverage_rules_are_met ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 477, in test_check_if_field_coverage_rules_are_met self.assertTrue(len(failures) == 0, msg=msg) AssertionError: The following items did not meet field coverage rules: dict/inStock (expected 1.0, got 0) dict/name (expected 1.0, got 0) dict/prices (expected 1.0, got 0) dict/productStatus (expected 1.0, got 0) dict/supplier (expected 1.0, got 0) dict/supplierSku (expected 1.0, got 0) dict/url (expected 1.0, got 0) 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] 11 monitors in 0.006s 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] FAILED (failures=5, skipped=1) 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] ---------------------------------------------------------------------- 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] 0 actions in 0.000s 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] OK 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] ---------------------------------------------------------------------- 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] 0 actions in 0.000s 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] OK 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... ERROR 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] ---------------------------------------------------------------------- 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) ERROR: [Spidermon] ====================================================================== ERROR: CustomTemplateSendSlackMessageSpiderFinished ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/core/actions.py", line 39, in run self.run_action() File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 252, in run_action self.manager.send_message( File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 58, in send_message return [ ^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 59, in self.send_message( File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 85, in send_message return self._send_channel_message( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 129, in _send_channel_message attachments=self._parse_attachments(attachments), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 171, in _parse_attachments python_attachments = ast.literal_eval(attachments) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/ast.py", line 64, in literal_eval node_or_string = parse(node_or_string.lstrip(" \t"), mode='eval') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/ast.py", line 50, in parse return compile(source, filename, mode, flags, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "", line 4 "text": "• _Extracted Items Monitor/test_stat_monitor_: Unable to find 'item_scraped_count' in job stats.\n• _Error Count Monitor/test_stat_monitor_: Expecting 'log_count/ERROR' to be '<=' to '0.0'. Current value: '57'\n• _Warning Count Monitor/test_stat_monitor_: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '1380'\n• _Finish Reason Monitor/Should have the expected finished reason(s)_: Finished with "closespider_timeout_no_item" the expected reasons are ['finished']\n• _Field Coverage Monitor/test_check_if_field_coverage_rules_are_met_: ^ SyntaxError: unterminated string literal (detected at line 4) 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] 1 action in 0.232s 2026-01-24 23:30:21 [mcmaster_carr] (PID: 101) INFO: [Spidermon] FAILED (errors=1) 2026-01-24 23:30:21 [scrapy.utils.signal] (PID: 101) ERROR: Error caught on signal handler: > Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 1253, in adapt extracted: _SelfResultT | Failure = result.result() ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/extensions/feedexport.py", line 504, in close_spider self._close_slot(slot, spider) File "/usr/local/lib/python3.11/site-packages/scrapy/extensions/feedexport.py", line 535, in _close_slot d: Deferred[None] = maybeDeferred(slot.storage.store, get_file(slot)) # type: ignore[call-overload] ^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/extensions/feedexport.py", line 517, in get_file assert slot_.file ^^^^^^^^^^ AssertionError 2026-01-24 23:30:21 [scrapy.statscollectors] (PID: 101) INFO: Dumping Scrapy stats: {'HeadersSpooferDownloaderMiddleware/session/created': 367, 'HeadersSpooferDownloaderMiddleware/session/spoofed': 1650, 'NotFoundHandlerSpiderMiddleware/AttributeError': 36, 'big_query/url': 367, 'downloader/exception_count': 13, 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 9, 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 2, 'downloader/exception_type_count/twisted.web._newclient.ResponseFailed': 1, 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 1, 'downloader/request_bytes': 1959446, 'downloader/request_count': 1650, 'downloader/request_method_count/GET': 1166, 'downloader/request_method_count/POST': 484, 'downloader/response_bytes': 42427422, 'downloader/response_count': 1637, 'downloader/response_status_count/200': 1310, 'downloader/response_status_count/301': 204, 'downloader/response_status_count/403': 123, 'elapsed_time_seconds': 1807.613876, 'finish_reason': 'closespider_timeout_no_item', 'finish_time': datetime.datetime(2026, 1, 24, 23, 30, 21, 280746, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 81769935, 'httpcompression/response_count': 826, 'items_per_minute': None, 'log_count/ERROR': 64, 'log_count/INFO': 73, 'log_count/WARNING': 1380, 'memusage/max': 281055232, 'memusage/startup': 125833216, 'parse_sesnapi/not-product-page': 150, 'poet/injector/catalog_extraction.pages.mcmaster_carr.McMasterCarrSingleProductPageObject': 99, 'proxy_manager/processed': 1650, 'proxy_manager/session_attached': 1650, 'renew_cat_cookie/103': 3, 'renew_cat_cookie/104': 3, 'renew_cat_cookie/105': 3, 'renew_cat_cookie/106': 3, 'renew_cat_cookie/110': 3, 'renew_cat_cookie/111': 3, 'renew_cat_cookie/135': 3, 'renew_cat_cookie/158': 3, 'renew_cat_cookie/16': 3, 'renew_cat_cookie/161': 3, 'renew_cat_cookie/163': 3, 'renew_cat_cookie/164': 3, 'renew_cat_cookie/167': 3, 'renew_cat_cookie/169': 3, 'renew_cat_cookie/180': 3, 'renew_cat_cookie/183': 3, 'renew_cat_cookie/186': 3, 'renew_cat_cookie/211': 3, 'renew_cat_cookie/213': 3, 'renew_cat_cookie/215': 3, 'renew_cat_cookie/217': 3, 'renew_cat_cookie/218': 1, 'renew_cat_cookie/219': 3, 'renew_cat_cookie/220': 3, 'renew_cat_cookie/221': 3, 'renew_cat_cookie/223': 3, 'renew_cat_cookie/225': 3, 'renew_cat_cookie/228': 3, 'renew_cat_cookie/23': 3, 'renew_cat_cookie/24': 3, 'renew_cat_cookie/241': 3, 'renew_cat_cookie/245': 3, 'renew_cat_cookie/271': 3, 'renew_cat_cookie/282': 3, 'renew_cat_cookie/291': 3, 'renew_cat_cookie/292': 3, 'renew_cat_cookie/340': 3, 'renew_cat_cookie/5': 3, 'renew_cat_cookie/61': 2, 'renew_cat_cookie/87': 3, 'renew_cat_cookie/95': 3, 'renew_cat_cookie/97': 3, 'renewed_cat_cookie/103': 3, 'renewed_cat_cookie/104': 3, 'renewed_cat_cookie/105': 3, 'renewed_cat_cookie/106': 3, 'renewed_cat_cookie/110': 3, 'renewed_cat_cookie/111': 3, 'renewed_cat_cookie/135': 3, 'renewed_cat_cookie/158': 3, 'renewed_cat_cookie/16': 3, 'renewed_cat_cookie/161': 3, 'renewed_cat_cookie/163': 3, 'renewed_cat_cookie/164': 3, 'renewed_cat_cookie/167': 3, 'renewed_cat_cookie/169': 3, 'renewed_cat_cookie/180': 3, 'renewed_cat_cookie/183': 3, 'renewed_cat_cookie/186': 3, 'renewed_cat_cookie/211': 3, 'renewed_cat_cookie/213': 3, 'renewed_cat_cookie/215': 3, 'renewed_cat_cookie/217': 3, 'renewed_cat_cookie/218': 1, 'renewed_cat_cookie/219': 3, 'renewed_cat_cookie/220': 3, 'renewed_cat_cookie/221': 3, 'renewed_cat_cookie/223': 3, 'renewed_cat_cookie/225': 3, 'renewed_cat_cookie/228': 3, 'renewed_cat_cookie/23': 3, 'renewed_cat_cookie/24': 3, 'renewed_cat_cookie/241': 3, 'renewed_cat_cookie/245': 3, 'renewed_cat_cookie/271': 3, 'renewed_cat_cookie/282': 3, 'renewed_cat_cookie/291': 3, 'renewed_cat_cookie/292': 3, 'renewed_cat_cookie/340': 3, 'renewed_cat_cookie/5': 3, 'renewed_cat_cookie/61': 2, 'renewed_cat_cookie/87': 3, 'renewed_cat_cookie/95': 3, 'renewed_cat_cookie/97': 3, 'request_depth_max': 9, 'response_received_count': 1433, 'responses_per_minute': None, 'retry/count': 91, 'retry/max_reached': 45, 'retry/reason_count/403 response': 81, 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 6, 'retry/reason_count/twisted.internet.error.TimeoutError': 2, 'retry/reason_count/twisted.web._newclient.ResponseFailed': 1, 'retry/reason_count/twisted.web._newclient.ResponseNeverReceived': 1, 'scheduler/dequeued': 1650, 'scheduler/dequeued/memory': 1650, 'scheduler/enqueued': 1656, 'scheduler/enqueued/memory': 1656, 'spider_exceptions/AttributeError': 9, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'start_requests/big_query': 367, 'start_time': datetime.datetime(2026, 1, 24, 23, 0, 13, 666870, tzinfo=datetime.timezone.utc)} 2026-01-24 23:30:21 [scrapy.core.engine] (PID: 101) INFO: Spider closed (closespider_timeout_no_item)