2026-01-17 23:00:10 [scrapy.utils.log] (PID: 151) INFO: Scrapy 2.12.0 started (bot: catalog_extraction) 2026-01-17 23:00:10 [scrapy.utils.log] (PID: 151) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36 2026-01-17 23:00:10 [mcmaster_carr] (PID: 151) INFO: Starting extraction spider mcmaster_carr... 2026-01-17 23:00:10 [scrapy.addons] (PID: 151) INFO: Enabled addons: [] 2026-01-17 23:00:10 [py.warnings] (PID: 151) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting. It will be removed in a future version of Scrapy. return cls(crawler) 2026-01-17 23:00:10 [scrapy.extensions.telnet] (PID: 151) INFO: Telnet Password: 05ea08bdf3f61886 2026-01-17 23:00:10 [py.warnings] (PID: 151) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2026-01-17 23:00:10 [scrapy.middleware] (PID: 151) INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.closespider.CloseSpider', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon'] 2026-01-17 23:00:10 [scrapy.crawler] (PID: 151) INFO: Overridden settings: {'BOT_NAME': 'catalog_extraction', 'CONCURRENT_ITEMS': 250, 'CONCURRENT_REQUESTS': 8, 'DOWNLOAD_DELAY': 0.9, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/mcmaster_carr/433fb11af3f811f0a2cd4200a9fe0102.log', 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: ' '%(message)s', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'catalog_extraction.spiders', 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter', 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 522, 524, 408, 429, 420], 'SPIDER_MODULES': ['catalog_extraction.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': None} 2026-01-17 23:00:11 [scrapy_poet.injection] (PID: 151) INFO: Loading providers: [, , , , , , ] 2026-01-17 23:00:11 [scrapy.middleware] (PID: 151) INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware', 'scrapy_poet.InjectionMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy_poet.DownloaderStatsMiddleware'] 2026-01-17 23:00:11 [NotFoundHandlerSpiderMiddleware] (PID: 151) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment. 2026-01-17 23:00:11 [scrapy.middleware] (PID: 151) INFO: Enabled spider middlewares: ['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware', 'catalog_extraction.middlewares.FixtureSavingMiddleware', 'scrapy_poet.RetryMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-01-17 23:00:11 [scrapy.middleware] (PID: 151) INFO: Enabled item pipelines: ['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline', 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline', 'catalog_extraction.pipelines.PriceRoundingPipeline', 'scraping_utils.pipelines.AttachSupplierPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline'] 2026-01-17 23:00:11 [scrapy.core.engine] (PID: 151) INFO: Spider opened 2026-01-17 23:00:11 [scrapy.extensions.closespider] (PID: 151) INFO: Spider will stop when no items are produced after 1800 seconds. 2026-01-17 23:00:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-01-17 23:00:11 [scrapy.extensions.telnet] (PID: 151) INFO: Telnet console listening on 127.0.0.1:6024 2026-01-17 23:00:18 [ProxyManagerDownloaderMiddleware] (PID: 151) INFO: Using brd-customer-hl_13cda1e4-zone-sharedpool_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware. 2026-01-17 23:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/inside-calipers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/outer-jacket-color~purple/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/instrumentation-ball-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/flammability-rating~ul-2556-ft4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/flammability-rating~ul-2556-vw-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/insulated-tube-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steam-pressure-gauge-siphons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/length~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collapsible-wire-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inside-calipers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001628588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/outer-insulation-color~purple&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=instrumentation-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/specifications-met~flame-rated-ft4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/specifications-met~flame-rated-vw-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulated-tube-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:00:52 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wire/outer-insulation-color~purple/ 2026-01-17 23:00:54 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wire/specifications-met~flame-rated-ft4/ 2026-01-17 23:00:55 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wire/specifications-met~flame-rated-vw-1/ 2026-01-17 23:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/american-wire-gauge-awg~26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-cabinet-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/electrical-plugs-and-receptacles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/insulation/shape~rectangular-tube/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~59-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/i-beam-tube-clamps/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 37 pages (at 37 pages/min), scraped 0 items (at 0 items/min) 2026-01-17 23:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collision-warning-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/wire-gauge~26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=colored-grease-gun-bands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-connectors/terminal-material~bronze-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=browse-electrical/type~receptacle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/shape~rectangular-tube&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~59-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003311994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-i-beam-tube-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:27 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wire/wire-gauge~26/ 2026-01-17 23:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:29 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/browse-electrical/type~receptacle/ 2026-01-17 23:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:32 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/size~59-64/ 2026-01-17 23:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/jobsite-boxes/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/internal-grooving-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/terminal-material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/inventory-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-cutting-snips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003311994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:48 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wire-connectors/terminal-material~bronze/ 2026-01-17 23:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=column-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-jobsite-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=internal-grooving-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-identification-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inventory-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-cutting-snips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-and-steel-hex-socket-pipe-fitting-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003311994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 83 pages (at 46 pages/min), scraped 0 items (at 0 items/min) 2026-01-17 23:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/iron-pipe-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-mesh/construction~crimped/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/iron-wing-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-mesh-partitions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/iron-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-identification-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-mesh-slings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:24 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-pipe-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-mesh/construction~crimped&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-protection-sleeving/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~no-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-wing-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-mesh-partitions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4656499217167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4656499217167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002421961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-mesh-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3236610467807&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=combination%20wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3236610467807%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489847%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~34-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9327T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229327T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-protection-sleeving&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/jacks/jack-type~lifting-bag/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-rope-sheaves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~no-11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-rope-swage-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~34-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:07 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~1/ 2026-01-17 23:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 125 pages (at 42 pages/min), scraped 0 items (at 0 items/min) 2026-01-17 23:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~no-34/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9327T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229327T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jacks/jack-type~lifting-bag&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-sheaves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~34-mm/ 2026-01-17 23:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~no-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965639372038&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965639372038%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968599%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-swage-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=commercial-bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:26 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~no-11/ 2026-01-17 23:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~no-34&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9327T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229327T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=28935T121&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2228935T121%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-threaded-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:36 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~no-34/ 2026-01-17 23:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/jancy-slugger-magnetic-base-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=composite-cores&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compact-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:45 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=28935T121&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2228935T121%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air-filter%252flubricators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/jars/capacity~18-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-food-grade-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jancy-slugger-magnetic-base-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wood-screws/drive-size~no-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wood-screws/drive-style~square/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=28935T121&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2228935T121%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/for-use-with~fuel-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 174 pages (at 49 pages/min), scraped 0 items (at 0 items/min) 2026-01-17 23:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jars/capacity-weight-~18-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/jaws/jaw-texture~serrated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wood-screws/length~160-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963946302057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bulkheads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963946302057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/drive-size~no-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/drive-style~square&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:18 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/jars/capacity-weight-~18-ml/ 2026-01-17 23:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:21 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488435%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000020582%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jaws/jaw-texture~serrated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wood-screws/screw-size~no-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/length~160mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979038566398&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979038566398%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083578%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motor-gear-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:39 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wood-screws/length~160mm/ 2026-01-17 23:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-rope-links/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/joints/fitting-connection~press-fit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/joints/connects-to~tube-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motors/mounting-position~vertical&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/knives/for-use-on~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/screw-size~no-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motors/thread-size~7-32-48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5513810907834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stepper%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5513810907834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090674%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334345%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=joints/connection-type~press-fit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=joints/connection-type~tube&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5513810907834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stepper%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5513810907834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005015938%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concrete-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stereo-microscopes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=woodworking-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:06 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/joints/connection-type~press-fit/ 2026-01-17 23:05:07 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/joints/connection-type~tube/ 2026-01-17 23:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/work-clothing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 225 pages (at 51 pages/min), scraped 0 items (at 0 items/min) 2026-01-17 23:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/junction-boxes/environment~sanitary/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/kalrez-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/labels/message~keep-dry/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sterile-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concrete-vibrators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sterilization-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=work-clothing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stick-electrodes/diameter~7-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~3-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=junction-boxes/environment~sanitary&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kalrez-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keep-dry-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9938597167718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stick%20electrodes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9938597167718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334816%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/conduit/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5861588236444&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5861588236444%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/key-ring-snaps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~5-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stickers/message~push&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adhesives/manufacturer~key-tite/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/conduit/fitting-type~support-clip/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951892007380&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stickers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951892007380%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002260147%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5861588236444&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5861588236444%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stirring-paddles/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 272 pages (at 47 pages/min), scraped 0 items (at 0 items/min) 2026-01-17 23:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/thread-size~pg-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:14 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/conduit/thread-size~1-4-28/ 2026-01-17 23:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9062N117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229062N117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=key-tite-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4630489527058&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stirring%20paddles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4630489527058%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conduit&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454937%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/type~support-clip&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5861588236444&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5861588236444%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-bender-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:30 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/conduit/type~support-clip/ 2026-01-17 23:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75145K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275145K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9062N117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229062N117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~0025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:42 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stones/color~blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1007la/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cone-flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9062N117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229062N117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0025&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/key-ring-snaps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0915&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951022873847&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stones&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951022873847%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stop-off-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~1007la&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:01 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~0915/ 2026-01-17 23:07:03 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:07:06 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~1007la/ 2026-01-17 23:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wrenches/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 318 pages (at 46 pages/min), scraped 1 items (at 1 items/min) 2026-01-17 23:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wrenches/material~aluminum-magnesium/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/keys/key-number~1043j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~chlorine&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~grain-alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1043j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/material~aluminum-magnesium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179313%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:24 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/material~steel/ 2026-01-17 23:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4983N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224983N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~1043j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:33 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/material~aluminum-magnesium&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/nema-type~l7-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:36 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~1043j/ 2026-01-17 23:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4983N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224983N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/nema-style~l7-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:43 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/connectors/nema-style~l7-15/ 2026-01-17 23:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:46 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:47 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4983N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224983N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/number-of-poles~37&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/shape~11-1-4-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/specifications-met~nas1564j12-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516957%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~2769/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132581%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:07:57 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/woven-wire-fencing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8903T75&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228903T75%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K163&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K163%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/thread-type~anpt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~2769&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~3975/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4881K024&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224881K024%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~hydrogen-bromide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102042%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 367 pages (at 49 pages/min), scraped 1 items (at 0 items/min) 2026-01-17 23:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8903T75&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228903T75%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K163&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K163%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3975&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4881K024&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224881K024%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=woven-wire-fencing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~sulfur-tetrafluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102042%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401256%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wrench-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8903T75&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228903T75%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K163&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K163%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4881K024&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224881K024%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102042%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~hydrogen-bromide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~120-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:47 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/strainers/fitting-connection~barbed-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:48 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:08:50 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095698%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:54 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:56 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~44358/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:08:56 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wrenches/square-drive-size~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/connection-style~barbed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/fitting-connection~barbed-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/individual-set~set&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~a1515/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:09 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/strainers/connection-style~barbed/ 2026-01-17 23:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 416 pages (at 49 pages/min), scraped 1 items (at 0 items/min) 2026-01-17 23:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~200-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~44358&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/for-use-with~deionized-water-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/square-drive-size~0-6875inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:17 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/individual-set~set/ 2026-01-17 23:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~25-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401759%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967804%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:26 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/square-drive-size~0-6875inches/ 2026-01-17 23:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wyes/fitting-connection~loc-line/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~a1515&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109879%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A242&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A242%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/strainers/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:36 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~a1515/ 2026-01-17 23:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~31-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~by11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/hazard-lights/bulb-type~xenon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wyes/connection-style~loc-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~8-1-4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A242&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A242%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:57 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/wyes/connection-style~loc-line/ 2026-01-17 23:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4121T3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224121T3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~4-7-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:02 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/strainers/material~brass/ 2026-01-17 23:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~by11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=xenon-hazard-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 464 pages (at 48 pages/min), scraped 2 items (at 1 items/min) 2026-01-17 23:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117016%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A242&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A242%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:16 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~co106/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:18 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~4-7-ml&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strapping-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~mc14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~10-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~mc6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:30 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~co106&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~160-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000139805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~p177/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:39 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~co106/ 2026-01-17 23:10:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~160-ml/ 2026-01-17 23:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~3-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/zinc-sheet-metal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~32-cu-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m12-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002399097%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~p177&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:56 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:10:56 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000009660048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401057%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~3-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-sheet-metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~r1064e/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~32-cu-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:09 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~3-ml/ 2026-01-17 23:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 511 pages (at 47 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stretch-wrap/material~polyethylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:13 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~32-cu-ft-/ 2026-01-17 23:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~sc8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:17 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/products/containers/capacity~8-1-4-gal/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-17 23:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~8-1-4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strike-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~r1064e&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8246808234932&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stretch%20wrap&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8246808234932%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=string-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~16-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:30 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~r1064e/ 2026-01-17 23:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~sc8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strip-door-mounting-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number~sm866/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001586981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~sc8/ 2026-01-17 23:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~7-1-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~y14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001625651%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bussmann-type-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/keys/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~sm866&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~7-1-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=butcher-block-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~y14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=butt-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:06 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~7-1-gal-/ 2026-01-17 23:12:07 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~y14/ 2026-01-17 23:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 557 pages (at 46 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~8-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:14 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:14 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-lacing/hook-type~long-leg-ll/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/zirconia-alumina-sanding-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:20 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/keys/material~aluminum/ 2026-01-17 23:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=convex-radius-end-mills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~8-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belts/lacing-type~bolt-on-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-lacing/hook-style~long-leg-ll&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-brush-holders/backing-width~7-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zirconia-alumina-sanding-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591276%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3496939935355&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3496939935355%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002394203%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-brushes/food-industry-standard~fda-compliant-21-cfr-177-1520&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:43 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/conveyor-belt-lacing/hook-style~long-leg-ll/ 2026-01-17 23:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5546066553624&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brush%20holders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5546066553624%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087618%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1855N2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221855N2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7377080483436&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brushes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7377080483436%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124342%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/knobs/thread-size~1-2-13/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-guide-mounting-rods/length~16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/knobs/thread-size~m3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1469N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221469N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:01 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5546066553624&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brush%20holders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5546066553624%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087618%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7984217990893&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20guide%20mounting%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7984217990893%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001601258%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/between-frame-width~21&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1855N2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221855N2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/knockout-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 606 pages (at 49 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/thread-size~1-2-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:11 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-guide-mounting-rods/length~16&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1360744530601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1360744530601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111888%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/thread-size~m3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1469N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221469N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5546066553624&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brush%20holders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5546066553624%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087618%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1855N2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221855N2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knockout-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=struts/strut-channel-type~curved&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1469N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221469N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:37 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2427054843101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=struts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2427054843101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982033%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:42 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/l-channels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/handle-style~three-spoke&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-wear-strip-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:55 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:13:56 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/knobs/handle-style~three-spoke/ 2026-01-17 23:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyors/environment~clean-room&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=l-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=951457901010&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B951457901010%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002256952%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-dispenser-hose-on-off-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 660 pages (at 54 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lags/screw-size~m6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-retention-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5734K212&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225734K212%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=suction-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cooler-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:20 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-knob-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lags/screw-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/box-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5734K212&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225734K212%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/latches/opens-with~knob/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-pro-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=support-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9974560404121&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9974560404121%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/american-wire-gauge-awg~14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/latching-door-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/latching-power-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077414%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latches/draw-locks-and-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5734K212&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225734K212%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latches/opens-with~knob&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~m40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:06 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/latches/draw-locks-and-latches/ 2026-01-17 23:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9731295768502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9731295768502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969627%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sure-joint-fastener-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 707 pages (at 47 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latching-door-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/material~bronze-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~0710-735-001/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latching-power-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:17 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12265A12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212265A12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~m40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3111105495877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cord%20grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3111105495877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cord-grips/thread-type~unf-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/thread-size~pg-13-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:33 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/cord-grips/for-knockout-trade-size~m40/ 2026-01-17 23:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~0710-735-001&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~173-002/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3111105495877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cord%20grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3111105495877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12265A12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212265A12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surge-tanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~8180-1-0-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/thread-type~unf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69915K116&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269915K116%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/computer-connection-type~db15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~173-002&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:53 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/cord-grips/thread-type~unf/ 2026-01-17 23:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12265A12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212265A12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/rags/rag-type~sweatshirt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453085%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~8180-1-0&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~6-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~l14-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69915K116&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269915K116%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7925K544&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227925K544%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:08 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~8180-1-0/ 2026-01-17 23:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 754 pages (at 47 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surveillance-cameras&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:14 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sweatshirt-rags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~a-19-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/nema-style~6-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/nema-style~l14-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~b-2489-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69915K116&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269915K116%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7925K544&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227925K544%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:29 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/nema-style~6-15/ 2026-01-17 23:16:31 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/nema-style~l14-30/ 2026-01-17 23:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~efp103/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/serial-port-interface~rs-232&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~a-19-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001567256%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~b-2489&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:45 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~480v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118977%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7925K544&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227925K544%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~6v-dc-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~efp103&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5928N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225928N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:54 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~b-2489/ 2026-01-17 23:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552951%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:56 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~a-19-ac&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553639%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-eca-het/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/actuator-style~cross-roller-plunger&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5839K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225839K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:07 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 804 pages (at 50 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5928N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225928N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001931840%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/certification~enec-marked&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:19 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-b&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-het&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5839K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225839K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7090K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227090K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/switches/panel-cutout-diameter~0-57/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corner-rounders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrugated-looms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5928N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225928N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8085T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228085T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~s452-159/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:40 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-het&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5839K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225839K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7090K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227090K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/switches/panel-cutout-diameter~17-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/wire-and-cable-use~hook-up-and-lead/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/duct-hose/material~cotton-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/for-panel-cutout-diameter~0-57&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:50 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8085T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228085T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:17:58 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~0-57/ 2026-01-17 23:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/switches/panel-cutout-diameter~3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~s452-159&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:01 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7090K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227090K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/for-panel-cutout-diameter~17-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/use-for~panel-and-equipment-hook-up-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cotton-duct-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 851 pages (at 47 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ldpe-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lead-screw-protectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8085T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228085T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:15 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~17-32/ 2026-01-17 23:18:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/cable/use-for~panel-and-equipment-hook-up-/ 2026-01-17 23:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/for-panel-cutout-diameter~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:23 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/markers/for-use-on~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/counters/measurement-unit~miles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/leather-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:28 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~3-8/ 2026-01-17 23:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ldpe-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screw-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:36 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/leds/bulb-shape-number~a23/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/screw-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leather-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/panel-cutout-diameter~2-19-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counters/unit-of-measure~miles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leather-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~alkali/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=983458193638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=countersinks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B983458193638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334357%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002213880%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:53 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/counters/unit-of-measure~miles/ 2026-01-17 23:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=LEDs/bulb-shape-number~a23&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~hydrogen-iodide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:18:59 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/screw-size~m10&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~alkalies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948839639468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948839639468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002060807%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967215%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~1-2-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 897 pages (at 46 pages/min), scraped 2 items (at 0 items/min) 2026-01-17 23:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~140-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~natural-gas-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~petroleum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:14 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/for-use-with~alkalies/ 2026-01-17 23:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1449T36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221449T36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001628959%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~5-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~varnish&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-2-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6564K99&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226564K99%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5428K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225428K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179272%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1449T36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221449T36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449455%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/switches/switch-action~instant-open/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~8-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5596K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225596K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6564K99&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226564K99%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~65-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1449T36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221449T36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5596K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225596K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6564K99&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226564K99%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~65a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:07 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:10 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:20:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 949 pages (at 52 pages/min), scraped 3 items (at 1 items/min) 2026-01-17 23:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shape~70-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5596K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225596K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:13 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/switching-current~65a/ 2026-01-17 23:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:16 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313119%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-reels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-shrouds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:27 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shape~70-elbow&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-voltage~60v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:28 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-stops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~7-8-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/switches/switch-action~instant-open/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/pipe-size~3-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333387%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-tie-downs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-diffusers/lens-pattern~cracked-ice/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/pipe-size~3-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coveralls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cr1025-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-type~socket/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape~cone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cracked-ice-light-diffusers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivel-plates/material~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cradle-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 996 pages (at 47 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=48758216288&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivel%20plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B48758216288%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:15 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crane-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:15 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-type~socket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape~cone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/light-bulbs/bulb-shape-number~par46/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:24 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:21:24 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~1-7-8-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:26 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:21:27 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/base-type~socket/ 2026-01-17 23:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~1-1-4-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape-number~t7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape-number~t4-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8697K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228697K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~1-7-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cross-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~m7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape-number~t7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape-number~t4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:50 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/swivels/thread-size~1-7-8-12/ 2026-01-17 23:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8697K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228697K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002053315%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1157a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002053626%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~13-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1044 pages (at 48 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2333N263&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222333N263%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~19-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8697K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228697K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002053315%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1157a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/drive-size~20-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/light-bulbs/bulb-shape-number~par46/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:24 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1157a/ 2026-01-17 23:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~13-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:27 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/drive-size~20-mm-1/ 2026-01-17 23:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2333N263&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222333N263%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~19-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:32 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002053315%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:36 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/size~13-mm/ 2026-01-17 23:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1448/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/size~19-mm/ 2026-01-17 23:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1665if/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:44 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2333N263&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222333N263%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:52 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1448&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringes/capacity~45-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1665if&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cup-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cup-oilers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:03 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1448/ 2026-01-17 23:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1134507702014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=syringes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1134507702014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128990%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:06 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:23:07 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:23:08 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1665if/ 2026-01-17 23:23:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1092 pages (at 48 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caged-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~243/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~300t3q-cl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~ip10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3456ll/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:22 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:23:22 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~370/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=custom-compression-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~243&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~300t3q-cl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/drive-size~ip10-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cut-to-length-rtd-probes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3456ll&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~243/ 2026-01-17 23:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~370&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:42 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~300t3q-cl/ 2026-01-17 23:23:44 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/t-handles/drive-size~ip10-1/ 2026-01-17 23:23:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~3456ll/ 2026-01-17 23:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:49 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~370/ 2026-01-17 23:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~48psb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~756/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~561/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~780/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~outlet-strip/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutting-board-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~48psb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~756&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~561&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~780&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1131 pages (at 39 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cvd-graphene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/thread-size~1-2-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:13 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~48psb/ 2026-01-17 23:24:14 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~756/ 2026-01-17 23:24:15 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~561/ 2026-01-17 23:24:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~780/ 2026-01-17 23:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~outlet-strip&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9944536682256&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20handles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9944536682256%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~roller-wheel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cut-to-length-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~track-roller/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~9145/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:25 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~outlet-strip/ 2026-01-17 23:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~3-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~b1a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~e37/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~roller-wheel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~track-roller&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~9145&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~roller-wheel/ 2026-01-17 23:24:47 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~track-roller/ 2026-01-17 23:24:48 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~9145/ 2026-01-17 23:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~e73/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~b1a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~epx/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~f14t12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~e37&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/size~3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:00 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~b1a/ 2026-01-17 23:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:03 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~e37/ 2026-01-17 23:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-label-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~e73&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:07 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/t-handles/size~3-mm/ 2026-01-17 23:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~epx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dark-thread-cutting-oils/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~f14t12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1176 pages (at 45 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:25:12 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~e73/ 2026-01-17 23:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/t-slotted-framing-rail-slides/t-slotted-framing-slide-type~pivoting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-latches/specifications-met~en-45545&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~epx/ 2026-01-17 23:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dark-thread-cutting-oils/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:18 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~f14t12/ 2026-01-17 23:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-lock-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~h6054/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2104451082401&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cam%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2104451082401%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004996493%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~h7551/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-rail-slides/rail-slide-type~pivoting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-rails/rail-height~20-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-rails/rail-height~80-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=80625A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2280625A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:38 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slotted-framing-rail-slides/rail-slide-type~pivoting/ 2026-01-17 23:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000054582%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~h6054&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~h7551&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=decorative-metal-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cut-to-length-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:50 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~h6054/ 2026-01-17 23:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=80625A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2280625A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:53 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~h7551/ 2026-01-17 23:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t12-light-fixtures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~15v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000054582%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~18v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~2-5v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~48v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=80625A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2280625A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1220 pages (at 44 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:14 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:14 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~7v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~15v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000054582%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~18v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~2-5v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553641%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~48v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:28 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553741%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/development-board-sensor-modules/barcode-symbology~code-11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tabletops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~7v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K77&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K77%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:37 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T05&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T05%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K555&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K555%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552942%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K567&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K567%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:48 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~10-8-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-board-sensor-modules/barcode-type~code-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~12-5-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/125-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tabs/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K555&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K555%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T05&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T05%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:05 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/development-board-sensor-modules/barcode-type~code-11/ 2026-01-17 23:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K77&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K77%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K567&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K567%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997023127579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tabs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997023127579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1270 pages (at 50 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~10-8w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~12-5w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~125w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K555&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K555%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:21 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~10-8w/ 2026-01-17 23:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T05&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T05%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K77&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K77%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K567&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K567%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:26 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~12-5w/ 2026-01-17 23:27:27 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~125w/ 2026-01-17 23:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:38 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tacky-surface-dusters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-boards/manufacturer-model-number~mkr-vidor-4000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:42 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:44 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:27:45 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tag-lines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-boards/memory-size~8-mb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:50 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/development-boards/manufacturer-model-number~mkr-vidor-4000/ 2026-01-17 23:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:53 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979761309988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=development%20boards&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979761309988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005156255%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~4-8-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dewalt-die-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dewalt-impact-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~193595g&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-resistant-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1387N303&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221387N303%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1323 pages (at 53 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tangless-helical-insert-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~657w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078504%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-gauges/mounting-position~vertical&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~4-8w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/light-diffusers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9483853800993&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tank%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9483853800993%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090674%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1387N303&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221387N303%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:30 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~4-8w/ 2026-01-17 23:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbide-tipped-lathe-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3711K713&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223711K713%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~pt23942&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-diffusers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-strap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diameter-tape-measures/length~6-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1387N303&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221387N303%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diamond-grit-reciprocating-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7128674698592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=diameter%20tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7128674698592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618631%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3711K713&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223711K713%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/linear-translators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~225-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:07 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1374 pages (at 51 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diaphragm-dispensing-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137262%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7128674698592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=diameter%20tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7128674698592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618631%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3711K713&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223711K713%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-translators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~27-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:21 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diaphragm-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/liners/flexibility~extra-flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077484%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137262%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7128674698592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=diameter%20tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7128674698592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618631%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:35 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/liquid-level-controllers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~70-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~1-3-8-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:48 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liners/flexibility~very-flexible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077484%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109776%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137262%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:55 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-level-controllers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/liquid-levels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=card-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:29:59 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/liners/flexibility~very-flexible/ 2026-01-17 23:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~1-3-8-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1424 pages (at 50 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077484%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~40-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:13 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:30:14 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~1-3-8-gal-/ 2026-01-17 23:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dielectric-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-levels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dielectric-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-2-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:26 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~40-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~11-16-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-72&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/locks/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:37 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~40-gal-/ 2026-01-17 23:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/locks/material~fabric-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=case-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/locks/opens-with~handle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tap-and-die-wrench-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/material~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:01 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/locks/material~bronze/ 2026-01-17 23:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~5-16-24-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/opens-with~handle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:06 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/locks/material~fabric/ 2026-01-17 23:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~5-8-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-die-and-drill-bit-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334704%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1474 pages (at 50 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/oil/engine-type~diesel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-and-die-wrench-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~9-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diesel-engine-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ladder-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/loctite-7113/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/loctite-9462/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=differential-pressure-transmitters/communication-protocol~io-link&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carrier-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-height-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lollipop-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6547774720592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=differential%20pressure%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6547774720592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982379%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/side-mount-bracket-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-7113&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-9462&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:31:56 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/casters/side-mount-bracket-casters/ 2026-01-17 23:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/loop-straps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-rail-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lollipop-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/loose-pin-butt-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1522 pages (at 48 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~lm1225cme&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:13 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loop-straps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dip-coating-pots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=direct-to-metal-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/low-profile-head-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004908070%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loose-pin-butt-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:29 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~lm1225cme&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tapered-ball-end-mills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/strip-doors/performance~low-temperature-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-profile-head-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceiling-grates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dishwashing-soap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cellophane-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-temperature-strip-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/component~stud-nut&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chain-grease/for-use-on~open-gears/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=distance-measuring-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271416%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lubricants/food-industry-standard~nsf-standard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~wd-40-specialist-penetrant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lubrication-cups/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2532A331&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222532A331%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/open-gear-and-chain-grease-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1570 pages (at 48 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cement-cutting-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/specifications-met~nsf-ansi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~wd-40-specialist-penetrant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%22290803211686%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=center-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubrication-cups&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2532A331&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222532A331%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:18 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/lubricants/specifications-met~nsf-ansi/ 2026-01-17 23:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4328T314&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224328T314%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/m8-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1347K53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221347K53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/machine-feet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2532A331&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222532A331%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4328T314&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224328T314%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=m8-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1347K53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221347K53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:43 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:33:46 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/products/taper-pin-drills/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-17 23:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/taper-pin-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/taps/thread-size~1-4-28/ 2026-01-17 23:33:47 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/lord-epoxy-adhesives. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-17 23:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/lord-epoxy-adhesives already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4328T314&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224328T314%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/made-to-order-pipe-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/magnetic-base-drill-cutting-fluids/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1347K53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221347K53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-buzzers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~2-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:03 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031867%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=made-to-order-pipe-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-base-drill-cutting-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:09 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/magnetic-card-holders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1618 pages (at 48 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/magnetic-driver-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dollies/easy-turn-dollies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/magnetic-label-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/magnetic-retractable-belt-barriers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-driver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~6-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-label-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~7-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/magnetic-zip-tie-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454886%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-retractable-belt-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-zip-tie-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/magnetic-card-holders already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/magnets/color~gray/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454886%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/taper-pin-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dot-color-coding-stickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/lord-epoxy-adhesives already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/magnets/magnet-grade~n35/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/color~gray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~9-32-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454886%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3815738403502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3815738403502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455003%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/grade~n35&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dovetail-milling-machine-vises&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:07 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/magnets/grade~n35/ 2026-01-17 23:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taper-pin-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:08 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dollies/easy-turn-dollies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/mandrels/for-use-with~surface-grinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1665 pages (at 47 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/mandrels/for-use-with~drill-presses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:14 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:14 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/manifolds/fitting-connection~quick-disconnect/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/manifolds/thread-type~nptf/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-739-adhesives%252fsealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/manual-hoists/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tarps/material~leather-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mandrels/for-use-with~surface-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mandrels/for-use-with~drill-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:32 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:33 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7664054701782&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tarps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7664054701782%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4498129930775&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4498129930775%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967766%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:35 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/connection-style~quick-disconnect&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:35 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4498129930775&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4498129930775%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967183%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/thread-type~nptf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manual-hoists&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:43 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/manifolds/connection-style~quick-disconnect/ 2026-01-17 23:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/marine-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7664054701782&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tarps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7664054701782%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=teach-pendant-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-049&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/markers/color~black-orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548063%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/markers/color~clear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tec-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=marine-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7664054701782&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tarps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7664054701782%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1709 pages (at 44 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:36:12 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-049&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~black-orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/markers/color~magenta-yellow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-and-belt-pulleys/belt-trade-size~xh&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/markers/color~purple/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001538892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~clear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:24 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6843160484390&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20and%20belt%20pulleys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6843160484390%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005438464%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8286N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228286N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527245%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-104&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~magenta-yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~purple&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103908%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masking-tape/color~orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/masks/for-use-with~acetone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002198455%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/masterkleer-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8286N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228286N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2584190231621&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2584190231621%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103908%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/material-lifts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masks/for-use-with~acetone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masterkleer-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8286N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228286N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tees/military-specification~ms20825-16j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3028195520048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3028195520048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1755 pages (at 46 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tee-nuts/thread-size~7-16-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103908%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=material-lifts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:19 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/specifications-met~ms20825-16j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tee-nuts/thread-size~7-16-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:28 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/tees/specifications-met~ms20825-16j/ 2026-01-17 23:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/fastener-head-type~set-screw-flat/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:31 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:35 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tefzel-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/shaft-type~barbed/barb-direction~two-way/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/mesh/mesh-size~4-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telephone-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/head-type~set-screw-flat&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/two-way-barbed-dowel-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~4-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:50 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/dowel-pins/head-type~set-screw-flat/ 2026-01-17 23:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telescoping-tube-structural-framing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:53 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/dowel-pins/two-way-barbed-dowel-pins/ 2026-01-17 23:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metal-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002066442%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain-cleanout-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-sticks/temperature-points~2000-f&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/fastener-head-type~through-hole/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1799 pages (at 44 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawer-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-sticks/temperature-points~425-f&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:13 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8273079560253&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20sticks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8273079560253%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982146%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/fastener-head-type~through-hole/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:14 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawers/material~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8273079560253&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20sticks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8273079560253%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001979551%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dremel-compatible-felt-polishing-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9970799178638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drawers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9970799178638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:25 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:25 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-switches/hazardous-location-rating~atex-ii-2-g-ex-db-iic-t6-gb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dremel-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1694A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221694A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=830330883100&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B830330883100%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148728%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~1-1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5032K67&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225032K67%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/bit-style~multidiameter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1694A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221694A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=test-leads/for-fluke-model-number~116&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001927238%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509211%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5032K67&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225032K67%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6196421921533&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=test%20leads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6196421921533%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1694A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221694A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~3-95-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5032K67&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225032K67%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1852 pages (at 53 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~35-ga-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/temperature-switches/ul-file-number~e217884/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:15 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~4-15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telephone-wire-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/fastener-head-type~through-hole&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~5-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~4-15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:27 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001619813%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001508930%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=textured-metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/temperature-switches/ul-file-number~e217884/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=textured-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~6-9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~7-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermal-imaging-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509014%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~8-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermally-conductive-ceramics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509227%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:05 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/hole-saw-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermocouple-connector-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1901 pages (at 49 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509014%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermocutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/hole-saw-kits-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:21 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermoelectric-coolers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:21 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:40:21 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:40:21 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bit-stop-collars/performance~depth-limiting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509014%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~5-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223511547928940%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001612209%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4044A15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224044A15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermoses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-point-type~brad/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/letter-size-depth-limiting-drill-bit-stop-collars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:42 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:43 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermostatic-steam-traps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~9-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:51 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/letter-size-depth-limiting-drill-bit-stop-collars/ 2026-01-17 23:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermostat-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001612209%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4044A15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224044A15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105081%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-26-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/point-style~brad&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-152&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:09 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/point-style~brad/ 2026-01-17 23:41:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 1956 pages (at 55 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-185&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000069310%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001612209%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4044A15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224044A15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~11-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~18-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~2-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-26mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000095544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~2-15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035832%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067906%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:29 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/shank-size~0-26mm/ 2026-01-17 23:41:32 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000108760%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:34 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~2-8mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/shank-size~2-8mm/ 2026-01-17 23:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~4-55-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/manufacturer-model-number~564&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~6-9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rod-eye-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000094494%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137787%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~2-1-2-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000040078%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~3-4-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454244%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451933%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2008 pages (at 52 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137787%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-type~uns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threading-die-stocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=throttle-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/threaded-pail-lids/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/thread-sealants/for-use-with~liquid-propane/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ticket-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107915%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137787%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~8-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/thread-sealants/for-use-with~liquid-propane/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-collet-bodies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001598294%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/tig-industry-number~10n44&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:44 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:42:45 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~8-ft&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/tig-torch-nozzle-size~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tilt-and-slide-clamping-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004780098%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/tig-torch-nozzle-size~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/timers/environment~washdown/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123875%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tilt-to-roll-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belt-end-plates/belt-trade-size~at10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6038886283542&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belt%20end%20plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6038886283542%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002003794%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2058 pages (at 50 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timers/environment~washdown-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-manufacturer-equivalent-number~w-640&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~16-at10-890&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:18 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/timers/environment~washdown-1/ 2026-01-17 23:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~25-at10-800&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005296074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~25-at10-890&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tinners-snips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~25-at5-545&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005298191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005296304%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295125%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toggle-switch-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tinners%27-snips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005298191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-flush-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/for-use-with~liquid-propane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-tank-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tooling-component-gripper-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pail-lids/lid-type~threaded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torq-set-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005298191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-angle-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964742%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2112 pages (at 54 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-stripes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/totes/capacity~330-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/totes/capacity~9-1-4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:18 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity~4-1-4-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=totes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123621%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity-weight-~330-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity-weight-~9-1-4-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=touch-probes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:32 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=touch-screen-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=towing-casters-(capacity-2000-lbs-and-above)&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=travel-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:36 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/totes/capacity-weight-~330-gal-/ 2026-01-17 23:44:37 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/totes/capacity-weight-~9-1-4-gal-/ 2026-01-17 23:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-pail-lids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tray-storage-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bend-and-stay-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tread-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tripod-dollies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trumpet-style-horns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-use-with~plastic-pellet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-positioners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~lp-gas-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984448%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2165 pages (at 53 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tubing/for-use-with~sulfur-oxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/flexibility~bend-and-stay&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/turners-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4935K136&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224935K136%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~soap-solutions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:20 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/tubing/flexibility~bend-and-stay/ 2026-01-17 23:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~6-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/specifications-met~sae-j524&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3089K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223089K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~sulphur-oxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000076905%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122946%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turner%27s-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/tubing/for-use-with~sulphur-oxide/ 2026-01-17 23:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4935K136&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224935K136%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezers/color~red&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezers/tweezer-trade-number~572&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5262K72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225262K72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5466K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225466K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9220K351&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229220K351%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3089K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223089K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweco-fusion-compatible-contact-tips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3656929274017&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tweezers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3656929274017%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522000%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3656929274017&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tweezers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3656929274017%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004443614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4935K136&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224935K136%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezers/tweezer-trade-number~5b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:02 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezers/tweezer-trade-number~572&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5262K72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225262K72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5466K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225466K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9220K351&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229220K351%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3089K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223089K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3656929274017&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tweezers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3656929274017%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2217 pages (at 52 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tweezers/tweezer-trade-number~m2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezers/tweezer-trade-number~72&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:17 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:46:18 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezers/tweezer-trade-number~5b&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tweezers/tweezer-trade-number~m2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5262K72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225262K72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twin-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5466K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225466K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9220K351&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229220K351%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:25 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3656929274017&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tweezers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3656929274017%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004248583%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twist-lock-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twist-tie-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:40 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:46:42 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:46:43 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-line-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-part-epoxy-paints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-way-guides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tygon-nd-100-65-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/u-joints/environment~food-and-beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-cup-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ultrasonic-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ultem-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2267 pages (at 50 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ultraviolet-lamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-joints/environment-1~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=undersized-key-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:18 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:18 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=uniforms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:24 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/u-joints/environment-1~food-and-beverage/ 2026-01-17 23:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=urinal-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=usb-flash-drives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=utility-knives/blade-type~self-retracting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=utility-sinks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~1120-j8m-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8540872660075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=utility%20knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8540872660075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~159-h3m-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~2l280&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005297536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=24575A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2224575A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005297508%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005280998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~3l440&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~360j4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~400j10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284296%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005297536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~4l318&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282158%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=24575A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2224575A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2320 pages (at 53 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~4l630&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5l570&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005297536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=24575A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2224575A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283677%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281205%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~360j4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5l670&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5l900&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:31 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5vx1900&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:36 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283753%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5vx660&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5vx730&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~600-r5m-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=underwater-cleanup-vacuums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~755-h5m-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005296610%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~a124&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~a48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283882%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283679%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2374 pages (at 54 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~ax83&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bb111&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bx32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bx44&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:20 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:20 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283679%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284066%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005312910%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~cx144&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283080%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpa1800&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281183%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpa882&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283679%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~a82&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/outer-circumference~113/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282701%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281530%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpz1800&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/color~clear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~1037-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:49:58 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~1282-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283309%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527245%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~177&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~113inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105104%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2427 pages (at 53 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000059229%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000159892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:14 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/v-belts/outer-circumference~113inches/ 2026-01-17 23:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~20-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~301&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000025314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000135900%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~40-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/valves/fitting-connection~snap-loc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~46-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~57&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-head-style-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valve-core-removers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valve-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084556%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000080052%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/connection-style~snap-loc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/fitting-connection~ball-socket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/fitting-connection~cam-and-groove&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:02 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/valves/connection-style~snap-loc/ 2026-01-17 23:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~potassium-sulfate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003411189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variable-speed-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variable-pitch-pulleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicator-contact-points/manufacturer-model-number~74-105996&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2483 pages (at 56 pages/min), scraped 3 items (at 0 items/min) 2026-01-17 23:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicator-contact-points/manufacturer-model-number~74-105998&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicator-contact-points/manufacturer-model-number~74-106363&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968123%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9771K117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229771K117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicator-holder-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9657484587707&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicator%20contact%20points&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9657484587707%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9657484587707&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicator%20contact%20points&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9657484587707%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114780%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9657484587707&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicator%20contact%20points&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9657484587707%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=46315K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2246315K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003411189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cloth/material~velvet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/environment~dusty&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9657484587707&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicator%20contact%20points&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9657484587707%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~513-404-10t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=46315K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2246315K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003411189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~646pka079b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113013%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vented-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:53 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/variance-indicators/manufacturer-model-number~646pka079b/ 2026-01-17 23:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=velvet-cloth&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9657484587707&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicator%20contact%20points&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9657484587707%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=46315K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2246315K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:01 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vehicle-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2535 pages (at 52 pages/min), scraped 4 items (at 1 items/min) 2026-01-17 23:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vertical-riser-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vents/shape~45-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:16 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibration-damping-u-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:17 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/spring-clamp-workholders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibratory-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vise-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2491040633414&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=vents&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2491040633414%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002312722%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/stools/mounting-location~wall/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2117K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222117K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=voltage-sensing-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vises/spring-clamp-workholders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=warning-lights/bulb-type~xenon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washdown-duplex-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-mount-stools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:43 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/vises/spring-clamp-workholders/ 2026-01-17 23:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/color~orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washer-style-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3067541930726&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=warning%20lights&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3067541930726%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2117K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222117K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an901-4c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5947T35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225947T35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-c1016/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-c3l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-c4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2117K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222117K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an901-4c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2586 pages (at 51 pages/min), scraped 4 items (at 0 items/min) 2026-01-17 23:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5947T35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225947T35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-d1816l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-c1016&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/for-screw-size~m27/ 2026-01-17 23:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-c3l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:18 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an901-4c/ 2026-01-17 23:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-c4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:22 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-c1016/ 2026-01-17 23:53:23 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-jd6l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:26 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-c3l/ 2026-01-17 23:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-842/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:28 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-c4/ 2026-01-17 23:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5947T35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225947T35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-847b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-d1816l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-856b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-913/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms20002-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-d1816l/ 2026-01-17 23:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-jd6l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-842&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:46 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms27183-62/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-847b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-856b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:50 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-jd6l/ 2026-01-17 23:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-913&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms20002-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:53 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-842/ 2026-01-17 23:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:53:56 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-847b/ 2026-01-17 23:53:57 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-856b/ 2026-01-17 23:54:00 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-913/ 2026-01-17 23:54:01 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms20002-4/ 2026-01-17 23:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/screw-size~m140&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms27183-62&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-516/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-506/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~din-34815&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2630 pages (at 44 pages/min), scraped 4 items (at 0 items/min) 2026-01-17 23:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448416%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:12 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms27183-62/ 2026-01-17 23:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~din-7980&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:16 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/products/vibratory-feeders/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-17 23:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/vibratory-feeders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-526/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-516&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-506&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:29 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms15795-516/ 2026-01-17 23:54:31 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms15795-506/ 2026-01-17 23:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-c0732r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-526&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-fn816p&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107229%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:41 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms15795-526/ 2026-01-17 23:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas620-8l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas620c8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151900%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:46 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-c0732r&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/screw-size~m25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002087811%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:51 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-fn816p&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449457%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:54 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas620-8l&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:54:54 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas620c8&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-sprinklers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449457%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=waterproof-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~din-6798/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=watering-wands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/vibratory-feeders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=waterproof-wood-glue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2681 pages (at 51 pages/min), scraped 4 items (at 0 items/min) 2026-01-17 23:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:15 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:55:15 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=way-wipers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:20 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weather-pack-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weatherheads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=webbing-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wedge-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weld-together-framing-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-guns/welding-process~mig&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-spool-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7142143351049&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20guns&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7142143351049%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002381053%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-torch-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weldwood-contact-cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheel-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/mount-type~socket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=whisk-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~din-6798/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010620%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wilkerson-compressed-air-lubricators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2730 pages (at 49 pages/min), scraped 4 items (at 0 items/min) 2026-01-17 23:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=window-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2248T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222248T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=window-frosting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1515-h12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=windsocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/welding-rods/for-joining~nickel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2248T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222248T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wipe-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002073593%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~18-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/welding-wire/aws-material-code~er316lsi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561445%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2248T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222248T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~22-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001560978%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561445%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:48 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~23-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8280T35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228280T35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561899%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561445%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~26-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8245K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228245K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8280T35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228280T35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561273%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:10 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:57:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2784 pages (at 54 pages/min), scraped 4 items (at 0 items/min) 2026-01-17 23:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8219K68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228219K68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8245K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228245K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:15 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8280T35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228280T35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/15-5-ph-stainless-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/100mxl-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drinking-water-barbed-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8219K68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228219K68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8245K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228245K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:28 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=15-5-ph-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/welding-wire/aws-material-code~er316lsi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=100mxl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/1018-carbon-steel-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drinking-water-barbed-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8219K68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228219K68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:42 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adjusters/adjustment-direction~linear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cooling-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:52 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/charts/for-use-with~pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-189/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=1018-carbon-steel-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjusters/adjustability~linear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cooling-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:02 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/adjusters/adjustability~linear/ 2026-01-17 23:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=charts/for-use-with~pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~m4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-189&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pins/diameter~4-5000-mm/diameter~4-500-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9931054749196&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9931054749196%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2828 pages (at 44 pages/min), scraped 4 items (at 0 items/min) 2026-01-17 23:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pins/diameter~4-0000-mm/diameter~4-000-mm/diameter~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20195A34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220195A34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~m4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:19 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498420%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:19 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~din-6798&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~4-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:24 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/couplings/thread-size~m4/ 2026-01-17 23:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heli-coil-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/thread-type~bspt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:31 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/diameter~4-5mm/ 2026-01-17 23:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20195A34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220195A34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~4mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-175/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002105809%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~elb0310/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/diameter~4mm/ 2026-01-17 23:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/inverted-retaining-rings/retaining-ring-type~external/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-type~bspt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20195A34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220195A34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-175&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~elb0310&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retaining-rings/inverted-external-retaining-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-rods/for-joining~nickel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:58:57 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516643%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151153%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:01 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6646950986674&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6646950986674%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%225994003645548%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:05 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-175&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-17 23:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N73&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N73%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drive-shafts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455264%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2876 pages (at 48 pages/min), scraped 4 items (at 0 items/min) 2026-01-17 23:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~elb1210n/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90213A105&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290213A105%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helical-vibration-isolators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pins/diameter~7-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N73&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N73%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~elb1210n&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/compartmented-bin-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90213A105&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290213A105%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N73&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N73%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/canvas-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compartmented-bin-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455264%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:40 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/bx88-v-belts. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-17 23:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bx88-v-belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:40 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/bearings/od~18-1016mm/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-17 23:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bearings/od~18-1016mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/shape~hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90213A105&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290213A105%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:43 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=canvas-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pins/diameter~7-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-brake-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:54 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:54 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-17 23:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/shape~hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:55 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-17 23:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/3d-printed-part-removal-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-17 23:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000141509%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-brake-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printed-part-removal-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chair-levelers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2921 pages (at 45 pages/min), scraped 4 items (at 0 items/min) 2026-01-18 00:00:11 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/c-clip-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/reusable-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bronze-carriage-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-013&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548492%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c-clip-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reusable-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-carriage-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:34 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bx88-v-belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bearings/od~18-1016mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/composite-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cpvc-pipe-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~7308-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~flammable-vapors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:46 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:46 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cpvc-pipe-fitting-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~7310/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~c144/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=composite-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-pipe-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~flammable-vapors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~7308-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/reversible-screwdriver-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-pipe-fitting-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179265%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~7310&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002127990%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 2964 pages (at 43 pages/min), scraped 4 items (at 0 items/min) 2026-01-18 00:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c144-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~eraa/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-0028/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089411%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reversible-screwdriver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cpvc-pipe-strainers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-228/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-4988/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~eraa&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-459/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~0-0028&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~mineral-spirits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cap-nuts/thread-size~5-8-11-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112103%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-pipe-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~0-0028/ 2026-01-18 00:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-228&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-4988&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6951K57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226951K57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-459&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pipe-reducers/material~bronze-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534640%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~mineral-spirits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cap-nuts/thread-size~5-8-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001508022%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/axles/diameter~1-11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:01:58 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-228&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:00 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cap-nuts/thread-size~5-8-11/ 2026-01-18 00:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6951K57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226951K57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K258&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K258%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drum-handlers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-pipe-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bronze-pipe-weld-elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx88/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3007 pages (at 43 pages/min), scraped 4 items (at 0 items/min) 2026-01-18 00:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~2-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~1-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~salt-water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6951K57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226951K57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000024026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K258&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K258%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-handlers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-pipe-weld-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~2-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~3-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4138N26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224138N26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014254%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~c60/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx88-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:40 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K258&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K258%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-243/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~salt-water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1058K18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221058K18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~3-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drum-movers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4138N26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224138N26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/a60-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c60-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:01 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-243&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1058K18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221058K18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-movers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3056 pages (at 49 pages/min), scraped 4 items (at 0 items/min) 2026-01-18 00:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4138N26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224138N26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548352%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bronze-screens/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~5-44/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=a60-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:21 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-243&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/axles/diameter~10-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1058K18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221058K18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:29 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~0-036/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-exhaust-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~5-44&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/axles/diameter~13-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~c87/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333505%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~10mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:47 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-036&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-exhaust-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:52 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:56 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/axles/diameter~10mm/ 2026-01-18 00:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-5-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001465708%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-plates/thickness~1-2-1/thickness~0-500/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~6-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c87-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metal-engravers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074405%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3100 pages (at 44 pages/min), scraped 4 items (at 0 items/min) 2026-01-18 00:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/axles/diameter~2-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:12 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/compression-force-sensors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1497K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221497K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~2-5625/od~2-9-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-plates/thickness~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~6-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~1-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-engravers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454641%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~2-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:32 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/aluminum-plates/thickness~1-2 2026-01-18 00:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333393%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-force-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1497K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221497K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ridgid-141-pipe-threaders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~2-9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/for-pipe-size~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~9-16-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/flags/message~air-force/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2435K104&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222435K104%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:52 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~2-9-16/ 2026-01-18 00:04:53 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/caps/for-pipe-size~1-1-4/ 2026-01-18 00:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/steel-wood-screw-threaded-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/helicoils/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1497K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221497K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/compression-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ridgid-141-pipe-threaders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~fz-6203-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~9-16-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-force-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-1-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3143 pages (at 43 pages/min), scraped 5 items (at 1 items/min) 2026-01-18 00:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/steel-wood-screw-threaded-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~5-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:19 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/barbed-air-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~fz-6203-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:23 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/anchors/steel-wood-screw-threaded-studs/ 2026-01-18 00:05:25 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/helicoils/thread-size~5-16-24/ 2026-01-18 00:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/helicoils/thread-size~m12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/240l-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-1-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100316%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-precision-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/right-angle-drill-attachments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:38 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~1-1-mm/ 2026-01-18 00:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/connection-style~barbed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/a286-super-alloy-hex-flange-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~m12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=240l-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:48 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/air-hose/connection-style~barbed/ 2026-01-18 00:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~m33/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-precision-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=right-angle-drill-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:05:55 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/helicoils/thread-size~m12/ 2026-01-18 00:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/rigid-shaft-coupling-guards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=a286-super-alloy-hex-flange-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009010%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/crimpers/for-use-with~bonded-polyester-strapping/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539669%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~m33&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3188 pages (at 45 pages/min), scraped 5 items (at 0 items/min) 2026-01-18 00:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-rod-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drums/capacity~80-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rigid-shaft-coupling-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334820%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metal-high-pressure-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cord-grips/environment~hazardous/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimpers/for-use-with~bonded-polyester-strapping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/abrasive-bristle-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/pipe-size~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-rod-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965401%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity-weight-~80-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/abrasive-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~20-0000-mm/diameter~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-high-pressure-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/environment~hazardous-location&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20885T263&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220885T263%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:44 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drums/capacity-weight-~80-gal-/ 2026-01-18 00:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-bristle-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:50 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/environment~hazardous-location/ 2026-01-18 00:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chemours-krytox-240ac-type-iii-grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/b120-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~15-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-128&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-034/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20885T263&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220885T263%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~4-5000-mm/diameter~4-500-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:07 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/dowel-pins/diameter~20mm/ 2026-01-18 00:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3233 pages (at 45 pages/min), scraped 5 items (at 0 items/min) 2026-01-18 00:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/limit-switches/actuator-style~cross-roller-plunger/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=b120-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~15-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:19 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-128&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemours-krytox-240ac-type-iii-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-034&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/computer-monitor-platforms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20885T263&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220885T263%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-16-27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~4-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562241%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496385%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cross-roller-limit-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:33 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/dowel-pins/diameter~4-5mm/ 2026-01-18 00:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-9-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8097T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228097T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8988K44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228988K44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-monitor-platforms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:40 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~5-16-27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~nic0078/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453686%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dry-running-sleeve-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-9-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8097T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228097T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~5-8-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8988K44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228988K44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~nic0078&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:02 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~1-9-64/ 2026-01-18 00:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113876%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~nic0191/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dry-running-sleeve-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3278 pages (at 45 pages/min), scraped 5 items (at 0 items/min) 2026-01-18 00:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8097T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228097T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~m12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~5-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8988K44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228988K44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N67&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N67%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bspp-to-npt-pipe-fitting-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449153%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drying-agents/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~nic0191&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:29 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~m12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:33 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~0-028/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metal-machine-component-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092313%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/captive-panel-bolts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bspp-to-npt-pipe-fitting-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:41 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/for-knockout-trade-size~m12/ 2026-01-18 00:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-sheet-metal-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/balls/diameter~1-4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drying-agents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~nic0636/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~0-028-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-machine-component-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/abs-(schedule-40)-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheet-metal-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/crown-staples/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:01 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/drive-size~0-028-1/ 2026-01-18 00:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:06 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/balls/diameter~1-4/ 2026-01-18 00:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/balls/diameter~1-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~pg-36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~nic0636&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3323 pages (at 45 pages/min), scraped 6 items (at 1 items/min) 2026-01-18 00:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs-(schedule-40)-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metal-o-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/buckles/attachment-type~sew-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crown-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~pg-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-o-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/buckles/buckle-type~set-screw/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckles/attachment-type~sew-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:34 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/balls/diameter~1-8/ 2026-01-18 00:09:35 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/for-knockout-trade-size~pg-36/ 2026-01-18 00:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/captive-panel-bolts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:39 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~7-8-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/buckles/buckle-type~spring-loaded-clamp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988424212043&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988424212043%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010731%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~13-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckles/buckle-type~set-screw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/captive-panel-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=29705T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2229705T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-109/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988424212043&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988424212043%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~7-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal%252fptfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckles/buckle-type~spring-loaded-clamp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5453K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225453K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449363%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3369 pages (at 46 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=captive-panel-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988424212043&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988424212043%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=29705T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2229705T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-109&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metal-pipe-fitting-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A765&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A765%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:26 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505249%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~14-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/carbon-dioxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~0-012/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5453K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225453K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=29705T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2229705T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/shaft-type~knurled/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9685T2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229685T2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-pipe-fitting-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/315l-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-dioxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-012&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A765&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A765%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5453K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225453K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:54 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/shaft-type~knurled&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~14-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9685T2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229685T2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001456969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/acetal-linear-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124943%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=315l-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:07 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~14-ga/ 2026-01-18 00:11:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3414 pages (at 45 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/absorbents/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A765&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A765%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:13 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:15 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/shaft-type~knurled&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~pmnn4497/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9685T2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229685T2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/acetal-quick-disconnect-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/rj-45-jack-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-linear-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~m26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=absorbents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:32 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circular-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~pmnn4497&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:40 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-quick-disconnect-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/acid-free-paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rj-45-jack-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~m26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~m28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chrome/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~m35/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/duct/connects-to~hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1467T44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221467T44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acid-free-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~m28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chrome&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~m35&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3460 pages (at 46 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~1-8504&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/thread-size~12-28-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/connection-type~hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1467T44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221467T44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-199/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000123247%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:23 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/duct/connection-type~hose/ 2026-01-18 00:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamp-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cord-routers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-208/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1467T44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221467T44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pins/thread-size~3-8-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-199&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/curtains/color~black-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-routers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pins/thread-size~3-8-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502296%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/thread-size~2-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-208&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:53 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:12:56 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:12:56 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8987K4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228987K4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334446%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curtains/color~black&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dies/thread-type~unf-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/diameter~1-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~arm/manufacturer~fanuc/manufacturer-series~crx/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:11 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/curtains/color~black/ 2026-01-18 00:13:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3505 pages (at 45 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2366A301&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222366A301%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K337&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K337%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458159%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/b80-v-belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8987K4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228987K4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:20 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~1-55mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~arm/manufacturer~fanuc/manufacturer-series~crx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-type~unf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/conduit/flammability-rating~ul-2556-vw-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~arm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2366A301&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222366A301%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K337&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K337%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:36 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~1-55mm/ 2026-01-18 00:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123328%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002259996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:37 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/dies/thread-type~unf/ 2026-01-18 00:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8987K4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228987K4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bottles/capacity~100-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/specifications-met~flame-rated-vw-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bottles/capacity~1025-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~arm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2366A301&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222366A301%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K337&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K337%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:55 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/conduit/specifications-met~flame-rated-vw-1/ 2026-01-18 00:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123328%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:13:59 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity-weight-~100-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~18-03-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/thread-size~6-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity-weight-~1025-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~18-1016-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:09 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bottles/capacity-weight-~100-ml/ 2026-01-18 00:14:11 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:14:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3549 pages (at 44 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:14:11 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:14 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bottles/capacity-weight-~1025-ml/ 2026-01-18 00:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/curtains/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~tl-5902/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~switch-padding/for-robot-arm-manufacturer~productive-robotics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cords/connects-to~pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/b80-v-belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drain-waste-and-vent-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~18-03mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~18-1016mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:30 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~18-03mm/ 2026-01-18 00:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/curves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curtains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~tl-5902&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~safety-padding/manufacturer~productive-robotics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:34 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~18-1016mm/ 2026-01-18 00:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/connection-type~pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain%2c-waste%2c-and-vent-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002076695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:41 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/robotics/robot-cell-component~safety-padding/manufacturer~productive-robotics/ 2026-01-18 00:14:44 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cords/connection-type~pipe/ 2026-01-18 00:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cords/material~acrylic-fiber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/digital-angle-finders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~2-15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cushioning-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2171N17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222171N17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/conduit/thread-size~pg-29/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/digital-calipers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000048805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/material~acrylic-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/digital-counters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-angle-finders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A237&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A237%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cushioning-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2171N17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222171N17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/thread-size~pg-29&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3594 pages (at 45 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-calipers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509730%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:17 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451301%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:17 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-counters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A237&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A237%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/circlip-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2171N17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222171N17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3185K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223185K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/circlips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/digital-levels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamps/material~wood-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~2-0625/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A237&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A237%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9791062983264&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clamps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9791062983264%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128377%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circlip-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:43 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3185K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223185K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circlips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-levels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~27-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:15:56 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/carbon-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-374/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3185K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223185K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~10-50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wet-concrete-anchors/mount-type~weld-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494794%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~27-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/conduit-box-shrouds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3639 pages (at 45 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-374&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~27-32/ 2026-01-18 00:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bottles/capacity-weight-~235-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:18 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/weld-on-stud-anchors-for-wet-concrete&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/nema-style~10-50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505991%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-box-shrouds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bottles/capacity~36-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:29 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/weld-on-stud-anchors-for-wet-concrete/ 2026-01-18 00:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/voltage~36v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:33 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cords/nema-style~10-50/ 2026-01-18 00:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/duct-gates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8950K612&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228950K612%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/diameter~2-7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-keys/finish~nickel-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:39 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/batteries/voltage~36v/ 2026-01-18 00:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/duct-hose-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity-weight-~36-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/voltage~60v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342665684929&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342665684929%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519486%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-gates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~2-441&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8950K612&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228950K612%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:54 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bottles/capacity-weight-~36-ml/ 2026-01-18 00:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~2-7mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000161271%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~2-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-hose-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:04 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~2-7mm/ 2026-01-18 00:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/acetal-linear-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/circular-electrical-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/voltage~60v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8950K612&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228950K612%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3685 pages (at 46 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/batteries/voltage~60v/ 2026-01-18 00:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bottles/capacity-weight-~235-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~44-025-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/din-125-flat-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~2-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~2-836&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/acetal-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-linear-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circular-electrical-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:26 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075706%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:30 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~2-836/ 2026-01-18 00:17:30 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:17:30 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/circular-saws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~44-025mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-125-flat-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cut-to-length-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/battery-backup-power-supplies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~1-13-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~44-025mm/ 2026-01-18 00:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-635/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nuts/fastener-strength-grade-class~astm-grade-2h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circular-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/draw-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/battery-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cut-to-length-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8523081672262&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8523081672262%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001570509%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-backup-power-supplies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-68/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~1-13-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-635&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3727 pages (at 42 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:18:12 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nuts/fastener-strength-grade-class~astm-grade-2h&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147221%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/battery-chargers/battery-voltage~12v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=draw-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-tank-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/diameter~3-3-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-68&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K766&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K766%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaned-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bottles/capacity~9-4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cutoff-wheels/diameter~16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-chargers/for-battery-voltage~12v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cords/voltage~25v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-tank-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~3-3mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K757&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K757%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:45 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/battery-chargers/for-battery-voltage~12v/ 2026-01-18 00:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K766&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K766%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:50 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~3-3mm/ 2026-01-18 00:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cutoff-wheels/diameter~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity-weight-~9-4-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutoff-wheels/diameter~16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/battery-operated-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~25v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/door-switches/actuator-style~bumper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K757&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K757%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:04 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bottles/capacity-weight-~9-4-gal-/ 2026-01-18 00:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-size-pin-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K766&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K766%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3773 pages (at 46 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutoff-wheels/diameter~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-operated-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumper-door-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000170017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1760N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221760N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K757&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K757%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/mounted-bearing-type~thread-mount/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~3-8-2/diameter~0-375&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:27 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clearance-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~20-042-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/duplex-strainers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~1-259/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000108941%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1760N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221760N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:42 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/3d-printers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/mounted-bearing-type~thread-mount&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/din-85-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~32-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~20-042mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duplex-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~1-259&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drawing-tubes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1760N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221760N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:05 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~20-042mm/ 2026-01-18 00:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3820 pages (at 47 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-85-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~32mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/confined-space-blowers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/battery-terminals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89965K414&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289965K414%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawing-tubes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:20 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:20:22 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~32mm/ 2026-01-18 00:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/din-939-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nuts-with-lock-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aerosol-marking-paint-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/din-960-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=confined-space-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-terminals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89965K414&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289965K414%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/din-961-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-939-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aerosol-marking-paint-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-960-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l240/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-caps/for-use-with~liquid-nitrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~4-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89965K414&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289965K414%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-961-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brackets/mounting-location~floor/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6974173590687&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6974173590687%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964862%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brackets/mounting-location~inside-corner/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~41-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l240-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=48805K148&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2248805K148%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3863 pages (at 43 pages/min), scraped 6 items (at 0 items/min) 2026-01-18 00:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~4-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:12 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/mounting-location~floor&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103872%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/core-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/mounting-location~inside-corner&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ampco-18-bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~41mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-caps/for-use-with~phosphoric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107802%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=48805K148&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2248805K148%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:33 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~41mm/ 2026-01-18 00:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6974173590687&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6974173590687%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/beads/comparable-to~lexan/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=core-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1088A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221088A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~6-51-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ampco-18-bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=48805K148&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2248805K148%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/acme-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~25-02-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beads/comparable-to~lexan&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dremel-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~6-51mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dresser-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:02 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9970513714292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9970513714292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313126%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acme-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-caps/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:06 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~6-51mm/ 2026-01-18 00:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~25-02mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3909 pages (at 46 pages/min), scraped 7 items (at 1 items/min) 2026-01-18 00:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9363K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229363K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6974173590687&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6974173590687%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/high-intensity-discharge-lamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dresser-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:18 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~25-02mm/ 2026-01-18 00:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clip-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/clamps/drill-chuck-mount-type~integral-arbor/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metal-wool-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1901K94&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221901K94%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ball-checks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9363K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229363K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hid-(high-intensity-discharge)-lamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/square-stock/material~garolite-1/material-grade~garolite-le-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/beads/comparable-to~tuffak/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamps/mount-type~arbor&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-wool-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1901K94&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221901K94%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-checks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9791062983264&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9791062983264%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010654%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9363K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229363K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/box-sealers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=e-glass-grade-garolite-square-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beads/comparable-to~tuffak&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/wire-and-cable-use~hook-up-and-lead/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1901K94&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221901K94%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9970513714292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9970513714292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308823%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:03 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bumpers/mount-type~slide-in/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=box-sealers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-caps/specifications-met~asme-b16-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3955 pages (at 46 pages/min), scraped 7 items (at 0 items/min) 2026-01-18 00:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9363K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229363K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~59-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:15 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/acid-tube-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6974173590687&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6974173590687%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/mount-type~slide-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bumpers/mount-type~threaded-stud/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~7-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~7mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9363K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229363K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010570%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~59-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-intensity-discharge-lamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:36 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~7mm/ 2026-01-18 00:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:40 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/mount-type~slide-in&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/mount-type~threaded-stud&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:42 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~59-64/ 2026-01-18 00:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~7-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9363K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229363K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bumpers/thread-size~1-1-4-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~6-7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:01 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-curtain-screens/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~6-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~6-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967631%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~81-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 3997 pages (at 42 pages/min), scraped 7 items (at 0 items/min) 2026-01-18 00:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:11 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~6-7-mm/ 2026-01-18 00:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-curtain-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~high-carbon-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~6-8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~81-000mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/easy-access-pipe-flanges already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acid-tube-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:25 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~6-8-mm/ 2026-01-18 00:24:27 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~81-000mm/ 2026-01-18 00:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/class-d-fire-extinguishers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~high-carbon-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bumpers/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930157%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-caps/specifications-met~astm-a536&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=class-d-fire-extinguishers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2508A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222508A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6974173590687&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6974173590687%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131524%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bumpers/thread-size~1-4-28/ 2026-01-18 00:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-driven-piston-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5723T17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225723T17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2508A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222508A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-driven-piston-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-drying-blowers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2508A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222508A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/acrylic-rod-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-drying-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:06 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/anchors/for-use-in~bricks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4043 pages (at 46 pages/min), scraped 8 items (at 1 items/min) 2026-01-18 00:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acrylic-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/anchors/for-use-in~drywall/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/easy-access-pipe-flanges already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/for-use-in~brick&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brackets/bracket-type~connecting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:20 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:20 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:23 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/anchors/for-use-in~brick/ 2026-01-18 00:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/for-use-in~drywall&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/exhaust-fans/drive-type~direct/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/cable/voltage~32v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/id~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/bracket-type~connecting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929793%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=direct-drive-exhaust-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:39 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/for-use-in~drywall&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metalworking-shears/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~9-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/voltage~5v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/3m-471-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metalworking-shears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~9-500mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~5v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:03 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~9-500mm/ 2026-01-18 00:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/elastic-cable-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552920%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:06 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ball-point-pens/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/corrosion-resistant-turnbuckles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4082 pages (at 39 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-471-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-point-pens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrosion-resistant-turnbuckles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/cable/voltage~32v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/edge-grommets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/elastic-cable-ties-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:29 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/anchors/elastic-cable-ties-5/ 2026-01-18 00:26:30 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-shaft-diameter~1-1-2/ 2026-01-18 00:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/3m-616-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/plain-bearings/plain-bearing-type~flanged-sleeve/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edge-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/serial-port-interface~rs-232/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/brown-loctite/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/sleeve-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-616-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/disc-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/oil-embedded-flanged-sleeve-bearings-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~rs-232&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/ring-material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bearings/id~3-5035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:51 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/oil-embedded-flanged-sleeve-bearings-7/ 2026-01-18 00:26:52 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/industry-designation~rs-232/ 2026-01-18 00:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/plain-bearing-type~sleeve&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ball-joint-rod-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~neon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disc-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/ring-material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969609%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:05 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/ring-material~steel/ 2026-01-18 00:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/rod-ends-and-linkages/ball-joint-rod-ends-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/cutters/for-use-on~polyethylene-pex-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cotter-pin-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/edging/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4122 pages (at 40 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~neon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~36-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:16 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:16 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965301%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brackets/finish~nylon-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cotter-pin-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-seal-type~open/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edging/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~36-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:28 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/edging/material~bronze/ 2026-01-18 00:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/casters/wheel-diameter~3-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/finish~nylon-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/seal-type~open&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:39 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/seal-type~open/ 2026-01-18 00:27:39 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/brown-loctite/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-18 00:27:39 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/cutters/for-use-on~polyethylene-pex-/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-18 00:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/cutters/for-use-on~polyethylene-pex-/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/brown-loctite/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:39 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/bearings/id~3-5035/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-18 00:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bearings/id~3-5035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~cpvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/wheel-diameter~3-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brackets/finish~vinyl-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:45 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47045T409&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247045T409%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:45 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~8-3-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949688381693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=coatings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949688381693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930253%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001922726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/american-wire-gauge-awg~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2320T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222320T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/finish~vinyl-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47045T409&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247045T409%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tie-down-rings/movement~360-swivel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~8-3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549723%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/wire-gauge~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:09 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~8-3-mm/ 2026-01-18 00:28:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4164 pages (at 42 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2320T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222320T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:11 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/finish~vinyl-coated&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47045T409&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247045T409%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:13 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cable/wire-gauge~8/ 2026-01-18 00:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/swiveling-tie-down-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/coatings/for-use-on~plastic-1/for-use-on~polyimide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:21 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/anchors/swiveling-tie-down-rings/ 2026-01-18 00:28:22 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:28:22 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/drill-bits/for-use-on~iron/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2320T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222320T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:24 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-cover-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-powered-caulk-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/air-hose/id~7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:30 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~polyimide-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:30 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-powered-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/air-hose/id~7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:38 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/coatings/for-use-on~polyimide-plastic/ 2026-01-18 00:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:40 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:44 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-caulk-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:44 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~2-1-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-speed-threaded-track-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~4-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metric-beveled-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~2-1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-powered-hacksaws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4-6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-beveled-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bearings/id~4-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:06 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-shaft-diameter~2-1-16/ 2026-01-18 00:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coil-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/material~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4203 pages (at 39 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497527%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-hacksaws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bands already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bungs/thread-type~unf-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/disposable-gloves/color~black-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8486A34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228486A34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bearings/id~4-500mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/drill-bits/for-use-on~iron/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~2-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bellows-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bungs/thread-type~unf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disposable-gloves/color~black&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8486A34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228486A34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:38 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bungs/thread-type~unf/ 2026-01-18 00:29:39 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/disposable-gloves/color~black/ 2026-01-18 00:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~2-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bellows-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/rotary-speed-sensors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-shaft-diameter~2-7-8/ 2026-01-18 00:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cleaners/for-use-on~hard-surfaces/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8486A34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228486A34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-powered-nibblers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-speed-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-on~hard-surfaces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-temperature-continuous-flex-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:00 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-nibblers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cleaners/for-use-on~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bearings/id~4-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929548%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:08 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:08 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/elastic-tie-down-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4241 pages (at 38 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/number-of-poles~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:13 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:30:13 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-on~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/bearings/id~4-500mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/number-of-wires~10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bar-racks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:18 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:18 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:30:20 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cleaners/for-use-on~iron/ 2026-01-18 00:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metric-cap-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elastic-tie-down-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/rotary-vane-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/number-of-poles~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/number-of-wires~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metric-cap-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bar-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-cap-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/tie-down-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-vane-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-cap-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/number-of-wires~18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adapters/tube-od~2-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/elbow-plug-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/tie-down-rings-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-0094/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:03 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/anchors/tie-down-rings-6/ 2026-01-18 00:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/elbow-swivel-joints/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~4-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/number-of-wires~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/for-tube-od~2-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbow-plug-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-samplers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4280 pages (at 39 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529923%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-0094&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/adapters/for-tube-od~2-1-2/ 2026-01-18 00:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbow-swivel-joints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/number-of-poles~42/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable-glands/thread-size~m16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162676%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-samplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:28 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4-500mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~5-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:39 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~4-500mm/ 2026-01-18 00:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/number-of-poles~42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/length~210/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-glands/thread-size~m16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~16007/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526920%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6782425493977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6782425493977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:52 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/air-powered-pipe-cleaner-kits. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-18 00:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~5-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/air-powered-pipe-cleaner-kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-shipping-mate-packaging-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~210&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7310K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227310K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8037K493&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228037K493%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~16007&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125975%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:08 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5040K636&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225040K636%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4329 pages (at 49 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/voltage~2000v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7310K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227310K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-033/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8037K493&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228037K493%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~dlcr2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3v280/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5040K636&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225040K636%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~2000v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7310K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227310K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-033&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8037K493&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228037K493%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dlcr2-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3v280-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5040K636&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225040K636%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:40 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:32:42 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable/voltage~30v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cylinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/air-powered-pipe-cleaner-kits already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/round-over-router-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/length~42/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:53 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/outer-jacket-material~nylon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=color-coding-cable-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~30v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/airless-spray-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002217783%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-over-router-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4375 pages (at 46 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7715T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227715T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/round-reflectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=airless-spray-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/airtight-containers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-067/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/countersinks/screw-size~5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7715T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227715T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-reflectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/vacuum-tube-tees/fitting-connection~barbed-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=airtight-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-067&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/for-screw-size~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7715T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227715T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:45 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105253%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:45 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~6-100-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barbed-vacuum-tube-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:50 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/countersinks/for-screw-size~5-16/ 2026-01-18 00:33:52 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/products/drill-bits/specifications-met~ansi/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-18 00:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~6-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/specifications-met~ansi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metric-end-mills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cardboard-trash-cans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:33:59 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/specifications-met~ansi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~6-1-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:05 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-096/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/length~96/length~8-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4417 pages (at 42 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~6-2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=colossus-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-end-mills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire/signal-type~data/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504636%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cardboard-trash-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:20 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~6-2mm/ 2026-01-18 00:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-096&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~8-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-018/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/use-for~data&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/alcohol/clean-room-standard~fed-std-class-100/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000125973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:35 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/air-hose/length~8-ft-/ 2026-01-18 00:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/beryllium-copper-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fitting-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003138104%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fitting-clamps/finish~enamel-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-018&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose/od~12-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alcohol/environmental-rating~fed-std-class-100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fitting-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6950136306066&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fitting%20clamps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6950136306066%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-036/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-hose-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beryllium-copper-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:34:59 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/alcohol/environmental-rating~fed-std-class-100/ 2026-01-18 00:35:00 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:35:00 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2663N27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222663N27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A013&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A013%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/od~12-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dollies/platform-style~solid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/barrier-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4462 pages (at 45 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-036&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass/shape~round-tube/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022471%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/certification~csa-certified&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2663N27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222663N27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A013&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A013%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498221%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5265K49&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225265K49%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dollies/platform-style~solid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrier-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002269638%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A071&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A071%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass/shape~round-tube&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4236684941730&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4236684941730%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969780%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2663N27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222663N27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A013&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A013%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5551584616364&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5551584616364%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002311201%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits-for-wood-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5265K49&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225265K49%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass/temper-rating~1-8-hard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cable-sheathing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A071&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A071%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dairy-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:01 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:36:02 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ansi-40-roller-chain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/barriers/material~fabric-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5265K49&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225265K49%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass/temper-rating~1-8-hard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4510 pages (at 48 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~8-4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cement/for-use-on~plastic-1/for-use-on~polyethylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-sheathing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A071&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A071%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5551584616364&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5551584616364%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002297359%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dairy-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-40-roller-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barriers/material~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:24 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8963K102&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228963K102%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~8-4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/barriers/material~foam-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cement/for-use-on~polyethylene-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:32 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/barriers/material~fabric/ 2026-01-18 00:36:33 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adapters/thread-size~1-1-8-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493238%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:40 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cement/for-use-on~polyethylene-plastic/ 2026-01-18 00:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~400j8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cement/for-use-on~porcelain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/thread-type~sae-lt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8963K102&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228963K102%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8486A553&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228486A553%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barriers/material~foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adapters/thread-size~1-2-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~1-1-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:36:59 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/barriers/material~foam/ 2026-01-18 00:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=400j8-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cement/for-use-on~porcelain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:03 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bushings/for-shaft-diameter~2mm/ 2026-01-18 00:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/thread-type~sae-lt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454475%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8963K102&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228963K102%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8486A553&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228486A553%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminized-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~1-2-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4558 pages (at 48 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/420xl-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2960338757520&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2960338757520%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109551%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adapters/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455324%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:22 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:37:23 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/thread-type~sae-lt&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-operated-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8486A553&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228486A553%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminized-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5670K54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225670K54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=420xl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adapters/thread-size~1-5-8-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass-alloy-360-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-chuck-bodies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-operated-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:45 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:37:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/adapters/thread-size~1-4-28/ 2026-01-18 00:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/door-closers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/rulers/length~4-m/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5670K54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225670K54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~1-5-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-bronze-shovels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-alloy-360-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/lid-supports/environment~clean-room/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448688%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-closers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~4-m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5670K54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225670K54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/fitting-type~union-1/for-use-with~oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51205K789&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251205K789%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4605 pages (at 47 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/center-reamers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-bronze-shovels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001615646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/clean-room-lid-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001919079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:23 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:38:24 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/clean-room-lid-supports/ 2026-01-18 00:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51205K789&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251205K789%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-composite-panels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-powered-mixers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/480l-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~22222/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/metric-rivet-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=center-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/460j8-v-belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/contactors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/460j8-v-belts already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51205K789&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251205K789%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-composite-panels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-mixers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=480l-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~22222&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:52 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-rivet-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:52 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-powered-routers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=contactors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:03 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/elbows/pipe-size~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ansi-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/roller-chain-attachments/chain-standard~ansi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4646 pages (at 41 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-48-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-routers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass-ball-lock-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-1695/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~0-234/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compact-c-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/pipe-size~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-roller-chain-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-48mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~1-0-gal/capacity~1-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-ball-lock-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-1695&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ceramic-coated-linear-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-234&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:39 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~0-48mm/ 2026-01-18 00:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~10-1-4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/sacrificial-anodes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/sae-64-bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014217%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~1-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/battery-connection~alligator-clip/battery-connection-protection~sheathed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A550&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A550%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-coated-linear-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:01 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~1-gal-/ 2026-01-18 00:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-point-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~10-1-4-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sacrificial-anodes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-1905/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4689 pages (at 43 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sae-64-bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-connection-type~sheathed-alligator-clip&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:14 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~10-1-4-gal-/ 2026-01-18 00:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-oxide-sanding-sponges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A550&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A550%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/ceramic-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=composite-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:23 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/batteries/battery-connection-type~sheathed-alligator-clip/ 2026-01-18 00:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-2031/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-1905&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/clips/mount-type~nail-in/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~1-7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-oxide-sanding-sponges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A550&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A550%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505978%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-213/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-2031&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/mount-type~hammer-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~1-7mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~11-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:55 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~0-586-32-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/air-tool-oilers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:40:59 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/clips/mount-type~hammer-in/ 2026-01-18 00:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-213&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:01 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~1-7mm/ 2026-01-18 00:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8491A098&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228491A098%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adapters/thread-size~m56/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass-dust-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001495890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4731 pages (at 42 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~11mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-straight-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~0-586-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-tool-oilers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A781&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A781%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:19 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/overall-width~11mm/ 2026-01-18 00:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air-moisture-separators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8491A098&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228491A098%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:24 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bushings/thread-size~0-586-32/ 2026-01-18 00:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~m56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-dust-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-connection-type~wire-leads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/appliance-rocker-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448923%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-straight-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A781&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A781%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-webbing-buckles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:42 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/batteries/battery-connection-type~wire-leads/ 2026-01-18 00:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8491A098&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228491A098%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-and-cable-strippers/ethernet-cable-category~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/clips/fitting-type~carabiner/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/doors/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=appliance-rocker-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~11-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=506136630644&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire%20and%20cable%20strippers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B506136630644%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002052478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A781&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A781%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-webbing-buckles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:03 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/type~carabiner&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4778 pages (at 47 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/decimal-reamers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/handbooks/title~american-electricians-handbook/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=doors/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~11-2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/clips/type~carabiner/ 2026-01-18 00:42:17 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:22 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/doors/material~iron/ 2026-01-18 00:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:25 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~11-2mm/ 2026-01-18 00:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/black-oxide-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/black-oxide-steel-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=decimal-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~18-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=american-electrician%27s-handbook&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=black-oxide-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~19-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=black-oxide-steel-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~3041-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/black-light-markers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/closed-style-linear-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~18mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026147%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/black-light-markers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:42:58 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/overall-width~18mm/ 2026-01-18 00:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass-heavy-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-force-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/delivery-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1796A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221796A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:04 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3041-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:04 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=closed-style-linear-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cloth/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4819 pages (at 41 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093146%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:16 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/crowfeet/size~1/ 2026-01-18 00:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-heavy-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=delivery-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1796A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221796A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~ethylene-glycol-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cloth/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-packing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~phenolic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968988%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:34 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cloth/material~bronze/ 2026-01-18 00:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cloth/material~cellulose-polyester-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-302/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1796A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221796A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/blades/precision-knife-blade-type~curve-cutting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~phenolic-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~10-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cloth/material~polyester-fabric-cellulose-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-302&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-spring-retainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:56 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cutters/for-use-on~phenolic-plastic/ 2026-01-18 00:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:43:57 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:43:59 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/cloth/material~polyester-fabric-cellulose-blend/ 2026-01-18 00:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/blade-type~curve-cutting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505839%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/arbors/machine-taper-number~cat-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adhesive-back-cable-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/blades/precision-knife-blade-type~cutting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:08 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/blades/blade-type~curve-cutting/ 2026-01-18 00:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/blades/precision-knife-blade-type~straight-cutting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4861 pages (at 42 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A011&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A011%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/salamander-heaters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~1025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/adapters/thread-type~unf/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arbors/shank-type~cat-40-taper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-back-cable-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/blade-type~general-purpose-cutting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/blade-type~general-purpose-straight-cutting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A011&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A011%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:27 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/arbors/shank-type~cat-40-taper/ 2026-01-18 00:44:29 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/blades/blade-type~general-purpose-cutting/ 2026-01-18 00:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=salamander-heaters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~1025&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:33 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/blades/blade-type~general-purpose-straight-cutting/ 2026-01-18 00:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass-magnetic-catches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~32-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A011&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A011%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~0-8764/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~liquid-helium-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-tube-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-magnetic-catches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969101%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~32mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:44:56 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-8764&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3441N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223441N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:02 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/overall-width~32mm/ 2026-01-18 00:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/number-of-pieces~117/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-brushes/handle-material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162042%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chain/roller-chain-trade-number~04b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-tube-straights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4908 pages (at 47 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/adapters/thread-type~unf/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3441N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223441N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~117&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/blades/knife-blade-trade-number~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-brushes/handle-material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~04b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:26 [scrapy.core.downloader.handlers.http11] (PID: 151) WARNING: Got data loss in https://www.mcmaster.com/cga-520-gas-tanks. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests 2026-01-18 00:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/number-of-pieces~29/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/cga-520-gas-tanks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:31 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/wire-brushes/handle-material~fiberglass/ 2026-01-18 00:45:31 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/chain/roller-chain-trade-size~04b/ 2026-01-18 00:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3441N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223441N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:37 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6002-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/trade-number~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~5-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~29&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~4-3-4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:47 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/blades/trade-number~12/ 2026-01-18 00:45:48 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:45:48 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:45:48 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6002zz&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/angle-identifiers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~5-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~4-3-4-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:00 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/bearing-trade-number~6002zz/ 2026-01-18 00:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drip-oilers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~6-1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~6-80/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:07 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~4-3-4-gal-/ 2026-01-18 00:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~40-cu-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065801%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4952 pages (at 44 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-identifiers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/number-of-pieces~7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/arms/clamp-type~c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1530A52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221530A52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/double-sided-polyester-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~7-16-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~6-80&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~40-cu-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/cga-520-gas-tanks already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/clutches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448698%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arms/clamp-type~c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:32 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~40-cu-ft-/ 2026-01-18 00:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1530A52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221530A52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001555292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~7-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/angle-iron-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9974799381500&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9974799381500%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clutches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454317%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448698%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1530A52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221530A52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~400-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-iron-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9974799381500&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9974799381500%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/cap-screws/military-specification~army-navy-specification/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448698%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:08 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-dogs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 4996 pages (at 44 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~400-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l370/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9974799381500&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9974799381500%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=army-navy-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/double-sided-polyester-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:18 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~400-gal-/ 2026-01-18 00:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:20 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~2587678-8005/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/electrical-cable-splices/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~sludge&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/for-use-with~sodium-carbonate-soda-ash/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l370-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:31 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~co114p3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969007%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:38 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:38 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~2587678-8005&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable-splices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5428K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225428K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass-push-button-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~sodium-carbonate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=co114p3-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~4-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~steam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099833%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:52 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-fittings/for-use-with~sodium-carbonate/ 2026-01-18 00:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N29&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N29%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5428K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225428K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/sandpaper-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/gas-tanks/outlet-cga-number~520/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~neon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-push-button-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~4-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5038 pages (at 42 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:14 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~4-6mm/ 2026-01-18 00:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6017-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N29&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N29%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5428K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225428K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/blind-rivet-installation-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~neon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~55-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cga-520-gas-tanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965301%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:32 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/adhesives/for-use-on~fiberglass/ 2026-01-18 00:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6017-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N29&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N29%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:36 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~molykote-g-0050-fm-white-ep/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blind-rivet-installation-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~55-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/anodes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~604-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~49-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:51 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~55-ml/ 2026-01-18 00:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/electrical-cord-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:55 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-molykote-g-0050fm-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~propylene-glycol/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anodes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/blower-motors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~604-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~49-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5082 pages (at 44 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cord-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~plaster/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000114715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~propylene-glycol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blower-motors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:29 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~1-9-16/ 2026-01-18 00:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/sanitary-stairs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=condensate-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~plaster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000114715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/sanitary-step-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3319N135&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223319N135%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6201-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-stairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conductive-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m3-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000114715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-step-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/hinges/range-of-motion~85/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3319N135&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223319N135%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6201-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~410611-0070/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5128 pages (at 46 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~2-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m3-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143447%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:18 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~21eza199/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000028439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/range-of-motion~85-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/wire-connectors/electrical-connection~vehicle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3319N135&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223319N135%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~410611-0070&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:32 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~2-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:34 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/range-of-motion~85-/ 2026-01-18 00:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~6-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~21eza199&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/anti-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086100%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:43 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~2-3-4/ 2026-01-18 00:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/sash-balances/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/coatings/for-use-on~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/connection-type~vehicle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:46 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078073%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N39&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N39%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:55 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/wire-connectors/connection-type~vehicle/ 2026-01-18 00:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~6-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anti-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sash-balances&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~leather&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~3-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:05 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~6-6mm/ 2026-01-18 00:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6207-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~110-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N39&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N39%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:11 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/coatings/for-use-on~leather/ 2026-01-18 00:51:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5175 pages (at 47 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/containers/capacity~90-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-025&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/coatings/for-use-on~plastic-1/for-use-on~polycarbonate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489927%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~7-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6208-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6207-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5510N166&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225510N166%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N39&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N39%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:30 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~3-1-2/ 2026-01-18 00:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~90-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101675%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:34 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-025&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~polycarbonate-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~7-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6208-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:41 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~90-ml/ 2026-01-18 00:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~17-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:44 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/coatings/for-use-on~polycarbonate-plastic/ 2026-01-18 00:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/micrometer-stages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5510N166&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225510N166%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:46 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~7-6mm/ 2026-01-18 00:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091758%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:48 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-alloy-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/saw-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/antislip-roller-wrap-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/coatings/for-use-on~vinyl-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~513-405-10t/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~17-32-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micrometer-stages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5510N166&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225510N166%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-alloy-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5220 pages (at 45 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saw-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:11 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/drive-size~17-32-1/ 2026-01-18 00:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antislip-roller-wrap-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~vinyl-fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/number-of-poles~25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~513-405-10t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adhesives/formulation~polymer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-angles/material~6061-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949688381693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949688381693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930411%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:26 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1712501638756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire%20connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1712501638756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553546%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~513-446-16a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~06b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brass-tube-fitting-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:34 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~vinyl-fabric&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1829K332&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221829K332%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/formulation~hybrid-polymer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-angles/material~6061-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/canisters/for-use-with~butane-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~513-446-16a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:51 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/adhesives/formulation~hybrid-polymer/ 2026-01-18 00:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~06b-ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-tube-fitting-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992004840104&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992004840104%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1829K332&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221829K332%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adhesives/formulation~silicate-cement/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137423%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:01 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~06b-ss/ 2026-01-18 00:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074799%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=butane-canisters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/coil-spring-retainers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-type~sds-max/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5263 pages (at 43 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1829K332&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221829K332%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/formulation~silicate-cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/butt-weld-pipe-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/converters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/brazed-plate-heat-exchangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128529%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coil-spring-retainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-type~sds-max&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:33 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7648T12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227648T12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/anvilets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=butt-weld-pipe-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/mig-gun-insulators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148456%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=converters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brazed-plate-heat-exchangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/astm-brass/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/anvilets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-761/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:49 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-type~sds-max&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:54 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7648T12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227648T12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:54 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~35/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-lacing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-gun-insulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adhesives/manufacturer~loctite/manufacturer-model-number~549/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-761&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~31-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5307 pages (at 44 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7648T12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227648T12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~35-ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-crimp-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496044%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-lacing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489977%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5vx680/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:22 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~35-ss/ 2026-01-18 00:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite-/manufacturer-model-number~549&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7149A88&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227149A88%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoist-ring-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:31 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~40-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5vx730/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~40h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083694%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6306-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5vx680-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:46 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite-/manufacturer-model-number~549&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/electrical-outlets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7149A88&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227149A88%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5vx730-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~40h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~a93/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/material~aluminum-2/thread-type~bspp/thread-type~bspt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6306-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~40-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:03 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~40h/ 2026-01-18 00:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-outlets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7149A88&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227149A88%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:10 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~40-2/ 2026-01-18 00:55:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5350 pages (at 43 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-bronze-chisels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~a93&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-british-standard-thread-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/conveyor-legs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/astm-d6779-nylon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:24 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/drill-bits/thread-size~1-8-28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~2-9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-bronze-chisels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-094/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7697K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227697K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-0953/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-legs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-d6779-nylon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/astm-hex-head-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~2-9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-094&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7697K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227697K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-0953&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~52-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:55:57 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/drive-sockets/size~2-9-16/ 2026-01-18 00:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-butt-weld-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000161174%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548259%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~c2080h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-hex-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:10 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-094&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:56:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5393 pages (at 43 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7697K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227697K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:11 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-0953&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~52-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-butt-weld-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:17 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/electrical-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:21 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/drive-size~52-mm-1/ 2026-01-18 00:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/chain-links/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~c2080h-ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bits/drive-style~asymmetrical/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/drill-bits/thread-size~1-8-28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:28 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/scoop-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:31 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~c2080h-ss/ 2026-01-18 00:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~2-1-2-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:38 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:38 [scrapy.core.scraper] (PID: 151) ERROR: Error downloading Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request return (yield download_func(request, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}] 2026-01-18 00:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6803-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=asymmetrical-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~13-051-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/fitting-type~reducer-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~2-1-2-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scoop-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-ferrules&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001931087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/screws/material~673-bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6803-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:56:59 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/couplings/thread-size~2-1-2-12/ 2026-01-18 00:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6803/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~13-051mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141541%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~2-56/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/mil-spec-cable-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:11 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~13-051mm/ 2026-01-18 00:57:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5435 pages (at 42 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=673-bronze-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/70xl-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6803h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx173/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~e14-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~2-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/breakers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-spec-cable-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:28 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/bearing-trade-number~6803h/ 2026-01-18 00:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/electrical-tape/color~red/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=70xl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489930%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031867%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx173-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-127/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/specifications-met~astm-d3311&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-tape/color~red&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/calipers/distance-measured~0-mm-to-600-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/coolant-lines/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/duct/component~duplex-receptacle-outlet-box-cover/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123004%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=704271490290&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B704271490290%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522000%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/sharpening-stones/abrasive-material~diamond/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-127&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1608T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221608T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:05 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-tape/color~red&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/maximum-measurement~600-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-lines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5479 pages (at 44 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/component~duplex-receptacle-outlet-box-cover&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524957%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/adjustable-nozzles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:15 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/calipers/maximum-measurement~600-mm/ 2026-01-18 00:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diamond-sharpening-stones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:21 [scrapy.core.scraper] (PID: 151) ERROR: Spider error processing (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-127&srchtxt=&mixedworld=force&workstationdata=true) Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data if table_data.get("partNumber") == sku: ^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' 2026-01-18 00:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-063/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1608T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221608T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aspirator-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/electrical-troughs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71865K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271865K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/paint/paint-type~chalkboard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/connectors/fitting-connection~quick-disconnect/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~15-0508-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-063&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1608T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221608T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aspirator-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-troughs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/mil-spec-hex-head-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71865K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271865K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chalkboard-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497135%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~15-0508mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:00 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~cr23500se-cj5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:03 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~15-0508mm/ 2026-01-18 00:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-spec-hex-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/connection-style~quick-disconnect&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bolts/military-specification~ms51575-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~688/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71865K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271865K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drill-vises/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/od~15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5522 pages (at 43 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 00:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:15 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/products/connectors/connection-style~quick-disconnect/ 2026-01-18 00:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~cr23500se-cj5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/specifications-met~iso-228-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/aluminum-extrusion-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/specifications-met~ms51575-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~688&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:27 [scrapy.downloadermiddlewares.retry] (PID: 151) ERROR: Gave up retrying (failed 3 times): 403 response 2026-01-18 00:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-vises&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002073606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333486%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:33 [mcmaster_carr] (PID: 151) WARNING: no value.entitites: https://www.mcmaster.com/bolts/specifications-met~ms51575-6/ 2026-01-18 00:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002127425%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~7-8-14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087571%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4092K711&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224092K711%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-extrusion-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6901/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax103/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502419%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~7-8-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drilled-spanner-drivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~ip6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 00:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/products/mil-spec-petroleum-jelly/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4092K711&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224092K711%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6901&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax103-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 151) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2026-01-18 01:00:11 [scrapy.extensions.closespider] (PID: 151) INFO: Closing spider since no items were produced in the last 1800 seconds. 2026-01-18 01:00:11 [scrapy.core.engine] (PID: 151) INFO: Closing spider (closespider_timeout_no_item) 2026-01-18 01:00:11 [scrapy.extensions.logstats] (PID: 151) INFO: Crawled 5571 pages (at 49 pages/min), scraped 8 items (at 0 items/min) 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... OK 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... FAIL 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... FAIL 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... FAIL 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] ---------------------------------------------------------------------- 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) ERROR: [Spidermon] ====================================================================== FAIL: Error Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/ERROR' to be '<=' to '0.0'. Current value: '289' 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) ERROR: [Spidermon] ====================================================================== FAIL: Warning Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '5467' 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) ERROR: [Spidermon] ====================================================================== FAIL: Finish Reason Monitor/Should have the expected finished reason(s) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 110, in test_should_finish_with_expected_reason self.assertTrue(finished_reason in expected_reasons, msg=msg) AssertionError: Finished with "closespider_timeout_no_item" the expected reasons are ['finished'] 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) ERROR: [Spidermon] ====================================================================== FAIL: Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 282, in test_maximum_retries self.assertLessEqual(max_reached, threshold, msg=msg) AssertionError: Too many requests (213) reached the maximum retry amount 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) ERROR: [Spidermon] ====================================================================== FAIL: Downloader Exceptions monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'downloader/exception_count' to be '<=' to '100.0'. Current value: '142' 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] 11 monitors in 0.151s 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] FAILED (failures=5, skipped=1) 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] ---------------------------------------------------------------------- 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] 0 actions in 0.000s 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] OK 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] ---------------------------------------------------------------------- 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] 0 actions in 0.000s 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] OK 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... ERROR 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] ---------------------------------------------------------------------- 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) ERROR: [Spidermon] ====================================================================== ERROR: CustomTemplateSendSlackMessageSpiderFinished ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit result = next(self._iterator) ^^^^^^^^^^^^^^^^^^^^ StopIteration During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/core/actions.py", line 39, in run self.run_action() File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 252, in run_action self.manager.send_message( File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 58, in send_message return [ ^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 59, in self.send_message( File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 85, in send_message return self._send_channel_message( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 129, in _send_channel_message attachments=self._parse_attachments(attachments), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 171, in _parse_attachments python_attachments = ast.literal_eval(attachments) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/ast.py", line 64, in literal_eval node_or_string = parse(node_or_string.lstrip(" \t"), mode='eval') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/ast.py", line 50, in parse return compile(source, filename, mode, flags, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "", line 4 "text": "• _Error Count Monitor/test_stat_monitor_: Expecting 'log_count/ERROR' to be '<=' to '0.0'. Current value: '289'\n• _Warning Count Monitor/test_stat_monitor_: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '5467'\n• _Finish Reason Monitor/Should have the expected finished reason(s)_: Finished with "closespider_timeout_no_item" the expected reasons are ['finished']\n• _Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount_: Too many requests (213) reached the maximum retry amount\n• _Downloader Exceptions monitor/test_stat_monitor_: Expecting 'downloader/exception_count' to be '<=' to '100.0'. Current value: '142'\n", ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ SyntaxError: invalid syntax. Perhaps you forgot a comma? 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] 1 action in 0.247s 2026-01-18 01:00:20 [mcmaster_carr] (PID: 151) INFO: [Spidermon] FAILED (errors=1) 2026-01-18 01:00:21 [scrapy.extensions.feedexport] (PID: 151) INFO: Stored bq feed (8 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1 2026-01-18 01:00:21 [scrapy.statscollectors] (PID: 151) INFO: Dumping Scrapy stats: {'HeadersSpooferDownloaderMiddleware/session/created': 1407, 'HeadersSpooferDownloaderMiddleware/session/spoofed': 6578, 'NotFoundHandlerSpiderMiddleware/AttributeError': 140, 'big_query/url': 1407, 'downloader/exception_count': 142, 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 127, 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 2, 'downloader/exception_type_count/twisted.web._newclient.ResponseFailed': 12, 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 1, 'downloader/request_bytes': 7958074, 'downloader/request_count': 6578, 'downloader/request_method_count/GET': 4696, 'downloader/request_method_count/POST': 1882, 'downloader/response_bytes': 176407133, 'downloader/response_count': 6436, 'downloader/response_status_count/200': 5062, 'downloader/response_status_count/301': 857, 'downloader/response_status_count/403': 517, 'dupefilter/filtered': 3, 'elapsed_time_seconds': 7208.918854, 'feedexport/success_count/BigQueryFeedStorage': 1, 'finish_reason': 'closespider_timeout_no_item', 'finish_time': datetime.datetime(2026, 1, 18, 1, 0, 20, 231581, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 392076179, 'httpcompression/response_count': 3180, 'item_scraped_count': 8, 'items_per_minute': None, 'log_count/ERROR': 295, 'log_count/INFO': 164, 'log_count/WARNING': 5467, 'memusage/max': 354787328, 'memusage/startup': 126115840, 'parse_sesnapi/not-product-page': 583, 'poet/injector/catalog_extraction.pages.mcmaster_carr.McMasterCarrSingleProductPageObject': 389, 'proxy_manager/processed': 6578, 'proxy_manager/session_attached': 6578, 'renew_cat_cookie/101': 3, 'renew_cat_cookie/1010': 3, 'renew_cat_cookie/102': 3, 'renew_cat_cookie/103': 3, 'renew_cat_cookie/1035': 3, 'renew_cat_cookie/1037': 3, 'renew_cat_cookie/104': 3, 'renew_cat_cookie/1053': 3, 'renew_cat_cookie/1071': 3, 'renew_cat_cookie/1077': 3, 'renew_cat_cookie/1083': 3, 'renew_cat_cookie/1084': 3, 'renew_cat_cookie/1087': 3, 'renew_cat_cookie/109': 3, 'renew_cat_cookie/1096': 3, 'renew_cat_cookie/1099': 3, 'renew_cat_cookie/1116': 3, 'renew_cat_cookie/1117': 3, 'renew_cat_cookie/112': 3, 'renew_cat_cookie/1120': 3, 'renew_cat_cookie/1121': 3, 'renew_cat_cookie/1128': 3, 'renew_cat_cookie/1133': 3, 'renew_cat_cookie/1141': 3, 'renew_cat_cookie/1147': 3, 'renew_cat_cookie/1169': 3, 'renew_cat_cookie/1183': 3, 'renew_cat_cookie/1186': 3, 'renew_cat_cookie/12': 3, 'renew_cat_cookie/1208': 3, 'renew_cat_cookie/1222': 3, 'renew_cat_cookie/1231': 3, 'renew_cat_cookie/1232': 3, 'renew_cat_cookie/1248': 3, 'renew_cat_cookie/1250': 3, 'renew_cat_cookie/1253': 3, 'renew_cat_cookie/1261': 3, 'renew_cat_cookie/1262': 3, 'renew_cat_cookie/1278': 3, 'renew_cat_cookie/1282': 3, 'renew_cat_cookie/1283': 3, 'renew_cat_cookie/1292': 3, 'renew_cat_cookie/1301': 3, 'renew_cat_cookie/1315': 3, 'renew_cat_cookie/1324': 3, 'renew_cat_cookie/1337': 3, 'renew_cat_cookie/1347': 3, 'renew_cat_cookie/1349': 3, 'renew_cat_cookie/1379': 3, 'renew_cat_cookie/1383': 3, 'renew_cat_cookie/1394': 2, 'renew_cat_cookie/1398': 2, 'renew_cat_cookie/1401': 1, 'renew_cat_cookie/142': 3, 'renew_cat_cookie/154': 3, 'renew_cat_cookie/155': 3, 'renew_cat_cookie/156': 3, 'renew_cat_cookie/160': 3, 'renew_cat_cookie/167': 3, 'renew_cat_cookie/180': 3, 'renew_cat_cookie/186': 3, 'renew_cat_cookie/192': 3, 'renew_cat_cookie/198': 3, 'renew_cat_cookie/201': 3, 'renew_cat_cookie/204': 3, 'renew_cat_cookie/206': 3, 'renew_cat_cookie/222': 3, 'renew_cat_cookie/225': 3, 'renew_cat_cookie/226': 3, 'renew_cat_cookie/230': 3, 'renew_cat_cookie/238': 3, 'renew_cat_cookie/249': 3, 'renew_cat_cookie/251': 3, 'renew_cat_cookie/254': 3, 'renew_cat_cookie/255': 3, 'renew_cat_cookie/258': 3, 'renew_cat_cookie/29': 3, 'renew_cat_cookie/298': 3, 'renew_cat_cookie/301': 3, 'renew_cat_cookie/302': 3, 'renew_cat_cookie/307': 3, 'renew_cat_cookie/308': 3, 'renew_cat_cookie/309': 3, 'renew_cat_cookie/310': 3, 'renew_cat_cookie/311': 3, 'renew_cat_cookie/321': 3, 'renew_cat_cookie/328': 3, 'renew_cat_cookie/329': 3, 'renew_cat_cookie/332': 3, 'renew_cat_cookie/334': 3, 'renew_cat_cookie/336': 3, 'renew_cat_cookie/339': 3, 'renew_cat_cookie/361': 3, 'renew_cat_cookie/386': 3, 'renew_cat_cookie/388': 3, 'renew_cat_cookie/39': 3, 'renew_cat_cookie/390': 3, 'renew_cat_cookie/407': 3, 'renew_cat_cookie/417': 3, 'renew_cat_cookie/426': 3, 'renew_cat_cookie/431': 3, 'renew_cat_cookie/432': 3, 'renew_cat_cookie/452': 3, 'renew_cat_cookie/454': 3, 'renew_cat_cookie/462': 3, 'renew_cat_cookie/468': 3, 'renew_cat_cookie/469': 3, 'renew_cat_cookie/474': 3, 'renew_cat_cookie/477': 3, 'renew_cat_cookie/491': 1, 'renew_cat_cookie/493': 3, 'renew_cat_cookie/515': 3, 'renew_cat_cookie/539': 3, 'renew_cat_cookie/542': 3, 'renew_cat_cookie/543': 3, 'renew_cat_cookie/545': 3, 'renew_cat_cookie/546': 3, 'renew_cat_cookie/571': 3, 'renew_cat_cookie/573': 3, 'renew_cat_cookie/590': 3, 'renew_cat_cookie/614': 3, 'renew_cat_cookie/616': 3, 'renew_cat_cookie/619': 3, 'renew_cat_cookie/629': 3, 'renew_cat_cookie/638': 3, 'renew_cat_cookie/656': 2, 'renew_cat_cookie/658': 1, 'renew_cat_cookie/680': 2, 'renew_cat_cookie/686': 3, 'renew_cat_cookie/693': 3, 'renew_cat_cookie/694': 3, 'renew_cat_cookie/695': 3, 'renew_cat_cookie/696': 3, 'renew_cat_cookie/697': 3, 'renew_cat_cookie/707': 3, 'renew_cat_cookie/71': 3, 'renew_cat_cookie/716': 3, 'renew_cat_cookie/717': 3, 'renew_cat_cookie/722': 3, 'renew_cat_cookie/743': 3, 'renew_cat_cookie/746': 3, 'renew_cat_cookie/752': 3, 'renew_cat_cookie/755': 3, 'renew_cat_cookie/756': 3, 'renew_cat_cookie/757': 3, 'renew_cat_cookie/767': 3, 'renew_cat_cookie/77': 3, 'renew_cat_cookie/795': 3, 'renew_cat_cookie/807': 3, 'renew_cat_cookie/808': 3, 'renew_cat_cookie/819': 3, 'renew_cat_cookie/827': 3, 'renew_cat_cookie/833': 3, 'renew_cat_cookie/835': 3, 'renew_cat_cookie/838': 3, 'renew_cat_cookie/840': 3, 'renew_cat_cookie/849': 3, 'renew_cat_cookie/860': 3, 'renew_cat_cookie/862': 3, 'renew_cat_cookie/864': 3, 'renew_cat_cookie/865': 3, 'renew_cat_cookie/881': 3, 'renew_cat_cookie/886': 3, 'renew_cat_cookie/890': 3, 'renew_cat_cookie/901': 3, 'renew_cat_cookie/925': 3, 'renew_cat_cookie/928': 3, 'renew_cat_cookie/935': 3, 'renew_cat_cookie/946': 3, 'renew_cat_cookie/958': 3, 'renew_cat_cookie/967': 3, 'renew_cat_cookie/97': 3, 'renew_cat_cookie/972': 3, 'renew_cat_cookie/979': 3, 'renew_cat_cookie/99': 2, 'renew_cat_cookie/998': 3, 'renewed_cat_cookie/101': 3, 'renewed_cat_cookie/1010': 3, 'renewed_cat_cookie/102': 3, 'renewed_cat_cookie/103': 3, 'renewed_cat_cookie/1035': 3, 'renewed_cat_cookie/1037': 3, 'renewed_cat_cookie/104': 3, 'renewed_cat_cookie/1053': 3, 'renewed_cat_cookie/1071': 3, 'renewed_cat_cookie/1077': 3, 'renewed_cat_cookie/1083': 3, 'renewed_cat_cookie/1084': 3, 'renewed_cat_cookie/1087': 3, 'renewed_cat_cookie/109': 3, 'renewed_cat_cookie/1096': 3, 'renewed_cat_cookie/1099': 3, 'renewed_cat_cookie/1116': 3, 'renewed_cat_cookie/1117': 3, 'renewed_cat_cookie/112': 3, 'renewed_cat_cookie/1120': 3, 'renewed_cat_cookie/1121': 3, 'renewed_cat_cookie/1128': 3, 'renewed_cat_cookie/1133': 3, 'renewed_cat_cookie/1141': 3, 'renewed_cat_cookie/1147': 3, 'renewed_cat_cookie/1169': 3, 'renewed_cat_cookie/1183': 3, 'renewed_cat_cookie/1186': 3, 'renewed_cat_cookie/12': 3, 'renewed_cat_cookie/1208': 3, 'renewed_cat_cookie/1222': 3, 'renewed_cat_cookie/1231': 3, 'renewed_cat_cookie/1232': 3, 'renewed_cat_cookie/1248': 3, 'renewed_cat_cookie/1250': 3, 'renewed_cat_cookie/1253': 3, 'renewed_cat_cookie/1261': 3, 'renewed_cat_cookie/1262': 3, 'renewed_cat_cookie/1278': 3, 'renewed_cat_cookie/1282': 3, 'renewed_cat_cookie/1283': 3, 'renewed_cat_cookie/1292': 3, 'renewed_cat_cookie/1301': 3, 'renewed_cat_cookie/1315': 3, 'renewed_cat_cookie/1324': 3, 'renewed_cat_cookie/1337': 3, 'renewed_cat_cookie/1347': 3, 'renewed_cat_cookie/1349': 3, 'renewed_cat_cookie/1379': 3, 'renewed_cat_cookie/1383': 3, 'renewed_cat_cookie/1394': 2, 'renewed_cat_cookie/1398': 2, 'renewed_cat_cookie/142': 3, 'renewed_cat_cookie/154': 3, 'renewed_cat_cookie/155': 3, 'renewed_cat_cookie/156': 3, 'renewed_cat_cookie/160': 3, 'renewed_cat_cookie/167': 3, 'renewed_cat_cookie/180': 3, 'renewed_cat_cookie/186': 3, 'renewed_cat_cookie/192': 3, 'renewed_cat_cookie/198': 3, 'renewed_cat_cookie/201': 3, 'renewed_cat_cookie/204': 3, 'renewed_cat_cookie/206': 3, 'renewed_cat_cookie/222': 3, 'renewed_cat_cookie/225': 3, 'renewed_cat_cookie/226': 3, 'renewed_cat_cookie/230': 3, 'renewed_cat_cookie/238': 3, 'renewed_cat_cookie/249': 3, 'renewed_cat_cookie/251': 3, 'renewed_cat_cookie/254': 3, 'renewed_cat_cookie/255': 3, 'renewed_cat_cookie/258': 3, 'renewed_cat_cookie/29': 3, 'renewed_cat_cookie/298': 3, 'renewed_cat_cookie/301': 3, 'renewed_cat_cookie/302': 3, 'renewed_cat_cookie/307': 3, 'renewed_cat_cookie/308': 3, 'renewed_cat_cookie/309': 3, 'renewed_cat_cookie/310': 3, 'renewed_cat_cookie/311': 3, 'renewed_cat_cookie/321': 3, 'renewed_cat_cookie/328': 3, 'renewed_cat_cookie/329': 3, 'renewed_cat_cookie/332': 3, 'renewed_cat_cookie/334': 3, 'renewed_cat_cookie/336': 3, 'renewed_cat_cookie/339': 3, 'renewed_cat_cookie/361': 3, 'renewed_cat_cookie/386': 3, 'renewed_cat_cookie/388': 3, 'renewed_cat_cookie/39': 3, 'renewed_cat_cookie/390': 3, 'renewed_cat_cookie/407': 3, 'renewed_cat_cookie/417': 3, 'renewed_cat_cookie/426': 3, 'renewed_cat_cookie/431': 3, 'renewed_cat_cookie/432': 3, 'renewed_cat_cookie/452': 3, 'renewed_cat_cookie/454': 3, 'renewed_cat_cookie/462': 3, 'renewed_cat_cookie/468': 3, 'renewed_cat_cookie/469': 3, 'renewed_cat_cookie/474': 3, 'renewed_cat_cookie/477': 3, 'renewed_cat_cookie/491': 1, 'renewed_cat_cookie/493': 3, 'renewed_cat_cookie/515': 3, 'renewed_cat_cookie/539': 3, 'renewed_cat_cookie/542': 3, 'renewed_cat_cookie/543': 3, 'renewed_cat_cookie/545': 3, 'renewed_cat_cookie/546': 3, 'renewed_cat_cookie/571': 3, 'renewed_cat_cookie/573': 3, 'renewed_cat_cookie/590': 3, 'renewed_cat_cookie/614': 3, 'renewed_cat_cookie/616': 3, 'renewed_cat_cookie/619': 3, 'renewed_cat_cookie/629': 3, 'renewed_cat_cookie/638': 3, 'renewed_cat_cookie/656': 2, 'renewed_cat_cookie/658': 1, 'renewed_cat_cookie/680': 2, 'renewed_cat_cookie/686': 3, 'renewed_cat_cookie/693': 3, 'renewed_cat_cookie/694': 3, 'renewed_cat_cookie/695': 3, 'renewed_cat_cookie/696': 3, 'renewed_cat_cookie/697': 3, 'renewed_cat_cookie/707': 3, 'renewed_cat_cookie/71': 3, 'renewed_cat_cookie/716': 3, 'renewed_cat_cookie/717': 3, 'renewed_cat_cookie/722': 3, 'renewed_cat_cookie/743': 3, 'renewed_cat_cookie/746': 3, 'renewed_cat_cookie/752': 3, 'renewed_cat_cookie/755': 3, 'renewed_cat_cookie/756': 3, 'renewed_cat_cookie/757': 3, 'renewed_cat_cookie/767': 3, 'renewed_cat_cookie/77': 3, 'renewed_cat_cookie/795': 3, 'renewed_cat_cookie/807': 3, 'renewed_cat_cookie/808': 3, 'renewed_cat_cookie/819': 3, 'renewed_cat_cookie/827': 3, 'renewed_cat_cookie/833': 3, 'renewed_cat_cookie/835': 3, 'renewed_cat_cookie/838': 3, 'renewed_cat_cookie/840': 3, 'renewed_cat_cookie/849': 3, 'renewed_cat_cookie/860': 3, 'renewed_cat_cookie/862': 3, 'renewed_cat_cookie/864': 3, 'renewed_cat_cookie/865': 3, 'renewed_cat_cookie/881': 3, 'renewed_cat_cookie/886': 3, 'renewed_cat_cookie/890': 3, 'renewed_cat_cookie/901': 3, 'renewed_cat_cookie/925': 3, 'renewed_cat_cookie/928': 3, 'renewed_cat_cookie/935': 3, 'renewed_cat_cookie/946': 3, 'renewed_cat_cookie/958': 3, 'renewed_cat_cookie/967': 3, 'renewed_cat_cookie/97': 3, 'renewed_cat_cookie/972': 3, 'renewed_cat_cookie/979': 3, 'renewed_cat_cookie/99': 2, 'renewed_cat_cookie/998': 3, 'request_depth_max': 9, 'response_received_count': 5579, 'responses_per_minute': None, 'retry/count': 445, 'retry/max_reached': 213, 'retry/reason_count/403 response': 344, 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 86, 'retry/reason_count/twisted.internet.error.TimeoutError': 2, 'retry/reason_count/twisted.web._newclient.ResponseFailed': 12, 'retry/reason_count/twisted.web._newclient.ResponseNeverReceived': 1, 'scheduler/dequeued': 6578, 'scheduler/dequeued/memory': 6578, 'scheduler/enqueued': 6586, 'scheduler/enqueued/memory': 6586, 'spider_exceptions/AttributeError': 35, 'spidermon/validation/fields': 168, 'spidermon/validation/items': 8, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'spidermon_field_coverage/dict/brand': 1.0, 'spidermon_field_coverage/dict/categories': 1.0, 'spidermon_field_coverage/dict/countryOfOrigin': 1.0, 'spidermon_field_coverage/dict/description': 1.0, 'spidermon_field_coverage/dict/imageUrl': 1.0, 'spidermon_field_coverage/dict/inStock': 1.0, 'spidermon_field_coverage/dict/isFreeShipping': 1.0, 'spidermon_field_coverage/dict/leadTime': 1.0, 'spidermon_field_coverage/dict/manufacturer': 1.0, 'spidermon_field_coverage/dict/manufacturerSku': 1.0, 'spidermon_field_coverage/dict/name': 1.0, 'spidermon_field_coverage/dict/packagingIncrement': 1.0, 'spidermon_field_coverage/dict/prices': 1.0, 'spidermon_field_coverage/dict/productStatus': 1.0, 'spidermon_field_coverage/dict/relatedSkus': 1.0, 'spidermon_field_coverage/dict/specifications': 1.0, 'spidermon_field_coverage/dict/supplier': 1.0, 'spidermon_field_coverage/dict/supplierSku': 1.0, 'spidermon_field_coverage/dict/uom': 1.0, 'spidermon_field_coverage/dict/url': 1.0, 'spidermon_field_coverage/dict/weight': 1.0, 'spidermon_item_scraped_count': 8, 'spidermon_item_scraped_count/dict': 8, 'spidermon_item_scraped_count/dict/brand': 8, 'spidermon_item_scraped_count/dict/categories': 8, 'spidermon_item_scraped_count/dict/countryOfOrigin': 8, 'spidermon_item_scraped_count/dict/description': 8, 'spidermon_item_scraped_count/dict/imageUrl': 8, 'spidermon_item_scraped_count/dict/inStock': 8, 'spidermon_item_scraped_count/dict/isFreeShipping': 8, 'spidermon_item_scraped_count/dict/leadTime': 8, 'spidermon_item_scraped_count/dict/manufacturer': 8, 'spidermon_item_scraped_count/dict/manufacturerSku': 8, 'spidermon_item_scraped_count/dict/name': 8, 'spidermon_item_scraped_count/dict/packagingIncrement': 8, 'spidermon_item_scraped_count/dict/prices': 8, 'spidermon_item_scraped_count/dict/productStatus': 8, 'spidermon_item_scraped_count/dict/relatedSkus': 8, 'spidermon_item_scraped_count/dict/specifications': 8, 'spidermon_item_scraped_count/dict/supplier': 8, 'spidermon_item_scraped_count/dict/supplierSku': 8, 'spidermon_item_scraped_count/dict/uom': 8, 'spidermon_item_scraped_count/dict/url': 8, 'spidermon_item_scraped_count/dict/weight': 8, 'start_requests/big_query': 1407, 'start_time': datetime.datetime(2026, 1, 17, 23, 0, 11, 312727, tzinfo=datetime.timezone.utc)} 2026-01-18 01:00:21 [scrapy.core.engine] (PID: 151) INFO: Spider closed (closespider_timeout_no_item)